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ABSTRACT 

Learning improvement programs for underprepared 
postsecondary students are reviewed, and a Decision Guide for 
Effective Programs, which summarizes knowledge needed for decision 
making, is presented. Research data are analyzed to identify features 
of learning improvement programs associated with improved grade point 
average and retention. Successful programs were found to have two 
broad characteristics in common: comprehensiveness in their support 
services, and institutionalization into the academic mainstream. The 
Decision Guide for Effective Programs includes a hierarchy of 
learning improvement programs that describes and ranks four types of 
programs: remedial courses, learning assistance to individual 
students, course-related learning services, and comprehensive 
learning systems. Twenty-six critical variables for learning 
improvement are presented in the Hierarchy of Decisions. The possible 
choices that educators can make for each variable are identified and 
ranked for effectiveness to increase overall academic achievement. 
The 26 variables are grouped as decisions relating to goals and 
rationale, instructional methods and content, institutional policies 
and standards, professional and paraprof essional staff and roles, and 
the evaluation of learning improvement programs. A bibliography is 
appended. (SW) 
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FOREWORD 



4 'For higher learning, the most precious asset is public confi- 
dence. Despite constrained resources, higher education has, 
on the whole, managed to maintain the quality of its pro- 
grams. But there are signs that quality standards are being 
jeopardized. Criticism is growing that many entering students 
are deficient in the academic skills necessary to successful 
pursuit of higher education, along withthe subsequent sug- 
gestion that degrees no longer certify those who earn them 
are men and women of learning , These warning signs will be 
ignored only at great peril. 

For this reason the Commission selected for its primary ah 
tention the issue of enhancing academic quality/' (1982. 
p.r.) 

This statement in the foreword of the National Commission's 
Report on Higher Education Issues entitled To Strengthen Qual- 
ity in Higher Education (Washington. D.C.: American Council 
on Education) indicates the importance to higher education of 
establishing methods to raise or maintain their academic stan- 
dards. 

One solution that has been offered is to change admission 
standards^ 'so only the brightest are allowed entrance. The ra- 
tionale is that if institutions admit students with academic defi- 
ciencies, then the quality of education will be lowered and the 
graduates will be a priori academically deficient. Not only is 
the assumption false — since it presumes once deficient, always 
deficient — it also ignores the historical mission of American 
higher education to provide educational opportunity to the larg- 
est number possible. 

This "solution" assumes that the only recourse for a college 
or university is to lower standards rather than improve student 
performance. 

The movement to raise admission standards has two other 
unacceptable results. First, it is indirectly racist, since a large 
majority of students demonstrating academic deficiences u r ** 
from minority groups. Second, it hinders the advancement of 
students who. through no fault of their own. have received an 
inferior education. 

Since the establishment of Harvard in 1636. higher education 
has consistently been faced with admitting students who needed 
additional help to meet academic standards. In the 1800*s. with 
the absence of a uniform high school system, institutions estab- 
lished preparatory units to help students move successfully into 
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the regular academic program Remedial o& developmental edu- 
cation programs have served the same role tod^y. 

In this report by Ruth Talbott Keimig, formerly the Dean of 
Freshman ana Chairman of the Learning Resources Division of 
Marymount College of Virginia and now a consultant in the 
area of adult education and training programs, these programs 
arc reviewed. After carefully analyzing why many developmen- 
tal programs have appeared to fail. Dr. Keimig develops a 
model that outlines the steps necessary to integrate learning im- 
provement practices into the regular academic process. The 
greater the integration of learning improvement practices, the 
greater the reinforcement and consequently the increased proba- 
bility of long term academic improvement. 

Institutions can turn their backs neither on academic stan- 
dards nor on countless students who have been a product of in- 
ferior schooling. Aside from the purely economic and survival 
reasons for many institutions to accept educationally disadvan- 
taged students, there is stili a need to fulfill the historical mis- 
sion of U S. higher education. The analysis in this report will 
greatly assist' institutions in meeting their mission while still 
raising their academic standards 

Jonathan D. Fife 

Director and Series Editor 

HhgT Clearinghouse on Higher Education 

The George Washington University 
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A study group in the mathematics of chemistry 
was just beginning, being led by one of our student 
counselors, who said. "As you all know, 100 
percent means one — the whole thing. . . 
* "That /.v not common knowledge / * interrupted 

an older student, with* firmness and dignity. "I 
just learned it yesterday." 

A Student Counselor in 
a College Learning 
Assistance Center. 

Cunicular reform of significance requires (I) 
overall thought but (2) piecemeal action. Overall 
thought tends to lead to attempts at overall action, 
but overall action tcftds to lead to overall resistance. 
Piecemeal action tends to follow piecemeal thought. 
The difficult task is to get^verall thought and then 
to have the patience and the persistence to carry 
out its conclusions one at a time. . . . 

President Lowell of 
Harvard University, 
quoted in Missions of 
the College Curriculum. 
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EXECUTIVE SUMMARY 



Making Decisions in an Imperfect World 

Most educators make decisions that directly affect students' 
learning and retention. Whether as faculty, administrator, pro- 
grarin manager, student services coordinator, or specialist, an 
educator's daily decisions have cumulative effects, for good or 
bad, that may not be readily and immediately discernible. Yet a 
choice must be made, usually among alternatives thai are 
poorly defined, shadowed by uncertainties beyond any one per- 
son's control, and constrained to ?lfes-than-ideai set of possi- 
bilities. 



So what's new? Haven't educational decisions 
always been difficult? 

The demographic depression and the-prevailing mood of de- 
cline, diminished resources, and threatened retrenchment are 
new, at least to this generation of faculty. So are the kinds of 
students new to the many institutions that have altered their ad- 
missions practices and curricula, as most institutions have done 
(Cross 1981; Carnegie Council 1980). Suppose too many stu- 
dents just drop the course, or transfer, or choose a different 
program with fewer and easier requirements? Compelled to 
choose between academic quality and retention, given today's 
underprepared mix of students, many educators make compro- 
mising and regrettable decisions. Abuses of integrity in the 
conduct of education are widespread (Carnegie Council 1979, 
1980; Levine 1980). Colleges and universities are maintaining 
enrollments by retaining whatever students they have, by re- 
cruiting more aggressively, by reducing admissions standards- 
and by allowing students to finesse their way around require- 
ments (Cross 1979; Manzo 1979). 



College and 
Universities 
are 

maintaining 
enrollments 
by retaining 
whatever 
students they 
have. 



Does it matter what students learn? 

. Students report cynicism about their academic ' "achievements" 
(Levine 1980, p. 66; Wellborn 1980). Faculty are not prepared 
to cope with the extreme diversity of students in their courses 
(Simmons et al. 1979; Cross 1976) and resent the circum- 
stances they arc forced to endure in today's educational envi- 
ronment. The public is losing confidence in and consequently 
diminishing support for higher education; that loss will rival the 
loss in prestige suffered by higher education during the 1960s 
era of student activism if integrity is not restored to the ed»ica- 
tional process (Carnegie Council 1980). 
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Improving the quality of learning for admitted students is 
basic to raising academic standards, becau& no other way ex- 
ists for our current students to succeed by academically honest 
criteria in sufficient numbers to ensure the survival of our insti- 
tutions and our programs. The improvement of instruction is 
the most urgent need in colleges and universities today (Carne- 
gie Council 1979, 1980; Carnegie Foundation 1977; Levine 
1980). 

Do learning improvement programs make a difference 
in the achievement of postseCondary students? 
Learning improvement programs have been the mainstay of 
higher education's response to its changing and underprepared 
student clientele. Whether designed to eradicate educational de- 
ficiencies (remedial) or to intervene with^an appropriate learn- 
ing experience at the time the need is recognized 
(developmental), since the 1966^ the expected payoff from 
these programs has been increased grade point average (GPA) 
and retention. Remedial/develqpmfental programs continue to be 
established in colleges and universities at a rate faster than any 
other type of course TMagarrcll 1981,* p. I). 

Learning improvement programs,-,however, have had mixed 
reviews in higher education (Richardson et al. 1981; Grant and 
Hoeber 1?78; Roueche and Snow 1977; '" toss 1976; Gordon 
1975). The ambiguity of published asse" ' :;its has its counter- 
point in equivocal attitudes among faculty, ho often regard 
developmental teaching as a mystery ("What can you do "with 
these students?"), a lifeline ("You must do sdwcthingC. 9 ), and 
a failure ("He fcis had Engljsh 099 and Still can't answer^ 
essay question. ). 



Using Research to Improve Learning and Retention 

Knowing what really has worked to improve pestsecondary 
achievement has been made more difficult by certain common 
but fallacious research practices . In many studies, (1) data 
about GPA ami retention are inappropriately used to assess the 
effect of students' participation in a single remedial course; ^ 
(2) quantitative outcomes from very different kinds of programs 
are averaged and statistically manipulated to provide general " 
conclusions about the effectiveness of learning improvement 
programs, as though die qualitative differences among the pro- 
grams and studies are unimportant; (3) the lack of a consistent 
framework of terminology about the goals, methods, structure* 
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and evaluation of teaming improvement programs interferes 
with comparing, understanding, and applying research results; 
and (4) important realities remain obscured and all effects are 
mistakenly attributed solely to whatever remedial/developmental 
service is being .evaluated because program evaluators usually 
" exclude relevant institutional factors from the analyses of 
causes and effects. 

Despite the limitation of some research studies f what 
practical knowledge can be obtained from the lUerature? 
A productive focus for action-oriented research is the qualita- 
tive analysis of successful programs to identify those specific 
practices that researchers have singled out as having positively 
contributed to improved GPA and retention. Researchers v/ho 
have studied the effects on GPA and retention of many differ- 
ent learning improvement programs have much to say to the 
on-line educator about what works and what does not work to • 
improve learning in college. Unfortunately, this extensive and 
important body of knowledge, derived from over 20 years of 
collective experience with postsecondary learning improvement, 
is generally inaccessible to academic faculty, administrators, 
and other decision makers who are oriented primarily to their 
own disciplines. Yet the findings and conclusions from these 
studies provide a base of practical, tested knowledge that could 
guide faculty and planners to those practices that have a record 
of having produced better learning. 

In successful learning improvement programs, 
what characteristics are associated with increased 
GPA and retention? 

Successful learning improvement programs are broadly de- 
scribed as having two dimensions: comprehensiveness and insti- 
tutionalization. 

.Individualized support services are provided with the flexibil- 
ity to meet a wide range of students' needs. Curricula are ad- 
justed in the planning of academic courses and .tutorial 
* assistance, remediation, and ongoing social and psychological 
support provided. 

In a successful program, the developmental concept is per- 
ceived as an institutional mission, and learning services are in- 
tegrated into the academic mainstream. The remedial/ 
developmental program has departmental or divisional status 
and maintains a close working relationship with the academic 
areas of the college or university. 
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- Less successful programs emphasize remedial courses and 
precollege treatments, providing no systematic support services 
in academic courses. Operating as an appendage outside the 
college mainstream, less successful programs fail to effect the 
long-term changes in the institution's and in students' behavior 
through which lasting gains in GPA and persistence are made. 

The Decision Guide for Effective Programs 
Based upon a qualitative analysis of proven successful prac- 
tices, the Decision Guide for Effective Programs summarizes 
the knowledge that pragmatic educators need to make informed 
decisions. The types and characteristics of postsecondary learn- 
ing improvement programs are classified and ranked for their 
effectiveness in increasing GPA and retention. The analysis and 
data provide a consistent, logical basis for comparing programs 
on their essential elements and for selecting beneficial prac- 
tices, despite the distraction of local, superficial differences in 
labeling or implementation. 

What types of learning improvement programs 
are generally used? 

In the Hierarchy of Learning Improvement Programs, four 
basic program types are described and ranked, differentiated by 
the extent to which they are comprehensive in response to the 
various needs of students and institutionalized into the aca- 
demic mainstream. 

Most common and least effective fire the Level I, isolated 
courses in remedial skills. In ascending order (for impact on 
GPA and retention) are programs that combine certain addi- 
tional etements to the basic courses: Level II, learning assis- 
tance to individual students; Level III, course-related 
supplementary learning activities for some objectives; and 
Level IV, comprehensive learning systems in academic courses. 

What program features and characteristics 
are associated with improved GPA and retention? 
Twenty-six critical variables for learning improvement are pre- 
sented in the Hierarchy of Decisions. The possible choices that 
educators can make for each variable are identified and ranked 
for effectiveness to increase overall academic achievement. 

For convenience, the 26 variables are grouped within the Hi- 
erarchy of Decisions, as decisions relating to goals and ratio- 
nale, instructional methods and content, institutional policies 
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and standards, professional and paraprofessional staff and roles, 
and the evaluation of learning improvement programs. The im- 
portance of some of the specific variables may be surprising, 
however, because they are typically not purposefully managed. 
Poor decisions about unrecognized but important determinants 
of achievement, therefore, often undercut an institution's effec- 
tiveness. 

Variables such ar> the perception of the institution's responsi- 
bility, the local rationale for learning services, and the prevail- 
ing attitude toward nontraditional students may seem intangible. 
Yet they have profound effects on students' achievement and 
are highly responsive to leadership within a college or 
university. 

Variables such as the responsiveness to students, the devel- 
opment of prerequisite skills, and the course instructor's role 
may appear tradition-bound and resistant to change. Yet they 
are readily evolved when remedial/developmental program re- 
sources are aligned with academic program resources to achieve 
specific, targeted goals. 

The proper management of variables such as the direction of 
students into appropriate courses and services, the enforcement 
of competencies in academic courses, and the use of systematic 
procedures for advisement restore greater control of educational 
processes and outcomes to the faculty. The necessity to com- 
promise quality to maintain enrollment is thereby reduced. 

Why is learning improvement inexorably bound to 
instructional change in today's postsecondary environment? 
As demonstrated in countless studies, the integration of learn- 
ing services into the ongoing academic life of the institution is 
clearly superior. Researchers and policy analysts have also 
reached a consensus for instructional change in colleges and 
universities. The consensus affirms that a level of learning ap- 
propriate for college disciplines is unattainable by most under- 
prepared students through traditionally delivered college 
instruction, regardless of previous, isolated remedial experi- 
ences. 

The potential of a particular decision to promote or inhibit 
change in the institution's academic programs is therefore an 
inherent value for ranking possible choices about policies and 
programs for improving learning. The involvement of other fac- 
ulty, administrators, and counselors profoundly affects both the 
content of the learning services offered as well as their success 
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by fostering not only remediation for prerequisite abilities but 
also facilitative adaptations in the presentation of the academic 
material. Gaps in background knowledge are bridged and inap- 
propriate behaviors of learners are overcome within the aca- 
demic setting so that genuine learning can occur. 

This interaction among academic and developmental educa- 
tors is the fundamental dynamic in successful learning improve- 
ment programs, producing gains in GPA and retention that 
cannot be delivered by remedial/developmental personnel work- 
ing alone in remedial settings. In most colleges and universities 
today, an administration that constrains developmental educa- 
tors to isolated roles consigns to itself and to the academic fac- 
ulty the unpleasant tasks of negotiating precarious compromises 
of program integrity amid today's relentless pressures for sur- 
vival. 

Overall Thought for Piecemeal Action 
Few educators enjoy the luxury of starting over or the freedom 
to single-handedly execute sweeping changes in existing pro- 
grams. Yet through their decisions, faculty and administrators 
control enormous resources that can be coordinated 'o produce 
greater control of learning outcomes than is commonly per- 
ceived. Educators need to know what specific activities and 
changes would be likely to improve learning, how to begin 
making the transition to more effective instruction, and how to 
focus resources on high-priority objectives. 

Educators who use the Decision Guide achieve greater con- 
trol of educational processes and outcomes through the use of 
more effective techniques of management, delivery, and evalu- 
ation. The use of the Decision Guide ensures the consideration 
of a full range of options and leads to the recognition of the 
possibilities available in an institution through the integration of 
existing resources, which are typically fragmented and under- 
used. Planners of instruction and student services find within 
the Decision Guide the best methods for bringing students to 
acceptable standards of achievement. The use of the Decision 
Guide fosters long-term planning, interdisciplinary innovation, 
and evolutionary change to more effective programs even as 
short-term constraints force an immediate continuation of less 
desirable alternatives. 

"Overall thought tends to lead to attempts at overall action, 
but overall action tends to lead to oveujll resistance. Piecemeal 
action tends to follow piecemeal thought,'* wrote Harvard 



president Lowell in 1938. 'The difficult task is to get overall 
thought and then to have the patience and the persistence to 
carry out its conclusions one at a time . . (Carnegie Founda- 
tion 1977, p. 16). The Decision Guide for Effective Programs 
— provides research-based overall thought to guide the pragmatic 
educator's piecemeal actions through which instructional pro- 
grams and change can be evolved. 



Raising Academic Standards 



17, 



KNOWING WHAT WORKS TO 
IMPROVE LEARNING 



To be useful in the decisions of busy educators, research results 
must be easily accessible, consistent, and relevant to their most 
pressing, practical concerns. The research literature on learning 
improvement programs, however, seems anything but practical 
and coherent to^he-praetitioneF-who reads-an-eecasional-st«djv- 
hoping to find a logical basis for decisions about instruction 
and student services. It is difficult to know what findings 
would be worthwhile in one's own situation because of the 
confusing differences among programs and studies, the impre- 
cise end. nonstandard terminology, and the sometimes contra- 
diciory .outcomes that seem so typical of the literature. Despite 
the obvious importance of knowing how to improve students' 
academic performance, the vast amount of knowledge that has 
been accrued from more than 20 years of collective experience 
remains hidden and fragmented. 

What is needed to make sense of this iiterature is a common 
and consistent framework of definitions, values, and criteria. 
Such a framework would provide a consistent method of ana- 
lyzing students' learning needs and outcomes in their colleges 
as well as a basis for comparing the findings of various re- 
search studies (Richardson et al, 1981; Walvekar 1981), 

Without such a framework for analyzing the data, the out- 
comes of learning improvement programs seem inconsistent and 
contradictory. Although many studies report positive effects on 
grade point average, the reported gains are often slight. Both 
negative and inconclusive reports are common, and a definitive 
assessment of the outcomes of learning improvement is not 
considered possible at this time (Richardson et al. 1981; 
Roueche and Snow 1977; Sherman and Tinto 1975). Long-term 
effects are rarely examined and are more likely to be equivocal 
than short-term effects, which are more likely to be positive 
(Trillin and Associates 1980). 

What has gone wrong? Surely learning improvement pro- 
grams should make a noticeable difference in the overall col- 
lege performance of the students who are served. Increasingly, 
the value sought by most colleges when they establish remedial/ 
developmental programs is improved learning and retention 
(Richardson et al. 1981; Maxwell 1979; Donnovan 1977; 
Fincher 1975; Pedrini and Pedrini 1970). The widespread use 
of inappropriate research designs for program evaluation, how- 
ever, has tended both to depress the outcomes demonstrated 
and to obscure the relative strengths and weaknesses of very 
different programs and practices. 
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Misleading Assumptions 

Implicit assumptions— which limit the real learning payoff and 
the demonstrability of positive outcomes — go unstated and 
unexamined in the design of many learning improvement pro- 
— grams amHheir evaluations. It is assumed that the "regular" 
academic program is a consistent criterion; that the "regular" 
program represents genuine, measurable learning; that the skills 
being developed through remediation are useful or necessary in 
other courses; that one instructor (remedial) should be held ac- 
countable for failures that occur in other ("regular") courses; 
that students should, can, or will choose to change their behav- 
ior permanently as a result of taking one remedial course. The 
evidence does not support these assumptions. 

Assumption: A remedial course can have 
a measurable effect on CPA 

Many programs and studies are constructed in the belief that a 
single variable, such as a characteristic of students (for exam- 
ple, reading ability or the participation in a precollege course), 
can be demonstrated statistically to influence CPA and re- 
tention. 



What is 

needed to 

make sense of 
this literature 
is a common 
and consistent 
framework of 
definitions, 
values and 
criteria. 



The evidence 

GPA and retention are complex outcomes with a large number 
of contributing factors (Carney and Geis 1981). Because educa- 
tional variables tend to be interrelated, attempts to control or 
isolate thent are usually unproductive (Donnovan 1977; Stuffle- 
beam 1971). No single factor universally and unambiguously 
makes a difference in learning (Grant and Hoeber 1978). It 
seems reasonable to conclude that, when GPA and retention 
outcomes are used, any study that is narrowly focused on a few 
closely related independent variables — as are so many studies 
of remedial/developmental programs — can demonstrate only 
slight effects. 

Assumption: The distinctions between 
remediation and college level work 
are based upon true differences 

The prevailing myths of remediation (Maxwell 1979; Chaplin 
1977b) and of "college level work" foster. the attitude, "They 
should have learned that in high school." As a consequence, 
remedial teaching tends to be isolated from the academic main- 
stream in special programs in which a separate remedial faculty 
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work toward the elimination of students' "deficits." If, later 
on, these students falter in the "real" academic world of othvr 
courses, the failures are cited as evidence of the ineffectiveness 
of the remedial program. 

The evidence 

Throughout the history of higher education in the United States 
and even today, agreement has never been reached on what 
constitutes "college level" instruction. The Carnegie Founda- - 
iion addressed this issue in a chapter entitled "Basic Skills — 
Where Does College Begin?" (1977, chap. 1 1). The practice 
of adapting college instruction to the needs of its students has 
been the norm and the tradition in this country (Maxwell 1979; 
Cross 1976).. Because of the double standaid in research, 
whose focus hps .been primarily remedial/developmental pro- 
- grams, traditionaPfoethods and courses of instruction tend to 
continue, unexamined for effectiveness and unresponsive to 
whatever student needs are revealed in the evaluations of the 
remedial/developmental programs (Richardson et al. 198!; 
Donnovan 1977).^ 

'? ' 

Assumption: GPA reflects learning 

GPA is assumed to be a measure of how much students have 
learned. 

# 

The evidence 

X strong tradition against evaluation, and resistance to it, exists 
in highei^education; systematic analysis of Jhe teaching/learning- 
process and its outcome, student achievement, is seldom under- 
taken (Webb 1J>77). Once installed, programs tend to stay (Ball 
1977). When programs are evaluated, they generally are poorly 
done (Grant and HoAer 1978; Sherman and Tinto 1975). In all 
but a few institutions with competency-based programs, credit 
hours completed is the significant statistic for determining suc- 
cess and the completion of requirements. 

Assumption: Student assessment equals program evaluation 
Many practitioners consider student assessment synonymous 
with program evaluation (Richardson et al. 1981; Grant and 
Hoeber 1978). As a consequence, evaluators gather too much 
microscopic data (about individual students and classes) and do 
not consider enough macroscopic data (about relevant but pos- 
sibly less easily quantified factors, such as the college, state, 
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and national aspects of the problem being investigated) (Stuffle- 
beam 1971). 



The evidenc e 

The knowledge that measurement can provide is limited. The 
traditional indices of change, such as opinion surveys, test 
scores, and GPA, offer insights but never illuminate enough 
(Donnovan 1977). The "soft" data are necessary and accept- 
able evidence in program evaluations. Soft data include evi- 
dence based on observation/testimony, clinical/case study, 
systematic expert judgment, and survey analysis, whereas 
"hard" data iftclude standardized student assessment, correla- 
tional status, and controlled experimental evidence (Ball 1977; 
Maxwell 1979). 



Using Research to Make Better Program Decisions 
Despite the ambiguities of published Assessments, expectations 
persist that remedial/developmental programs can improve stu- 
dents* performance in the overall college program (Richardson 
et ah 1981; Magarrell 1981). The continued willingness of col- 
lege administrators to invest in remedial/developmental pro- 
grams and the persistence of positive outcomes with regard to 
GPA and retention in some careful, published studies despite 
the inadequacies, unknowns, and obstacles to good research 
may be testimony to the redemptive power of these programs in 
the colleges they serve (Roueche and Snow 1977). On the other 
— hand, the persistence oTpositive statistics an GPA and retention 
may also reflect an institution's or curriculum's symbiotic adap- 
tation through grade inflation and lowered standards to the stu- 
dents it has, without whom there would be no program. 
College planners need to know what is occurring in their insti- 
tutions and need to effect positive control on the processes of 
change. 

Decision makers need to know the answers to several ques- 
tions: Do certain kinds of learning improvement programs af- 
v tect the overall learning of students differently? Are these 
differences masked in summaries of the conclusions* that com- 
bined results of very different kinds of programs? Which de- 
cisions within a college directly affect students' academic 
performance? For the educator seeking to maximize the payoff 
(in academic performance and persistence) from investment in 
remedial/developmental programs, what intermediate out- 
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comes — for the institution as well as its students — should be 
sought? 

Given today's environment for higher education and the . 
widely expressed mandate to improve postsecondary instruction 
(Cole 1982; Newton 1982; McCabe 19.81; Levine 1980; Carne- 
gie Council 1979, 1980; Carnegie Foundation 1977; Trillin and 
Associates 1980; Cross 1976, 1979; Maxwell 1979; Roueche 
and Snow 1977), the central issue becomes, What constitutes 
improved instruction? Which "basic processes" within the in- 
stitution should be the subject of evaluation and possible reform 
when the goal is to improve students' retention and GPA? 

"Better instruction" in today's educational environment is 
that which would enable contemporary students to learn and 
faculty to cope with the prevailing realities in ways that do not 
dilute the academic content of their courses and programs. Four 
specific circumstances inhibit learning yet are contemporary 
realities that educators must accommodate: a decline in basic 
skills, a shift in power, a willingness to cheat, and an intense 
competition for students. 

Many and in some institutions most entering" college students 
do not comprehend, write; compute, think analytically, or solve 
problems adequately for college study (Watkins 1981; Roueche 
1981-82; Levine 1980, p. 72; Maxwell 1979; Newsweek 
1975). The decline in basic skills affects all levels of ability 
and socioeconomic classes of students and cannot be attributed 
solely to shifts in the population of students entering college 
(Carnegie Foundation 1977, pp. 212-13). However, population 
shifts also are reflected in the changing nature of students 
(Cross- 198 1 ; Carnegie Council 1980). . 

In these economic hard times, faculty and institutions have 
lost power in relationship to students (Levine 1980). Even the 
most fundamental policies that every course instructor expects _ 
to control— grading practices, the acceptable quality and num- 
ber of assignments, rules for attendance — tend to become nego- 
tiable currencies in daily confrontations between students and 
instructors (Cross 1979; Carnegie Foundation 1977; Manzo 
1979). And on the average, students tend to win (Ashdown 
1979). 

Motivated largely by the desire to be able to get a job rather 
than by a quest for knowledge or by humanistic goals, many 
students cheat to get the grades they need — in all kinds of in- 
stitutions, including the most prestigious and selective (Levine 
1980, p, 66; Wellborn 1980, p. 39). 
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In the coming two decades, the proportion of students who 
are most diverse will increase, including students who are fe- 
male, black, Hispanic, part-time, foreign, and concurrently en- 
rolled in high school (Cross 1979, 1 981; Carnegie Council 
1980; Mayhew 1979). Institutions will compete harder to re- 
cruit, satisfy, and retain students, 40 percent of whom now 
drop out, boredom being cited most often as the reason for 
leaving (Carnegie Council 1980, p. 53). 

Countless faculty-student-administrator transactions comprise 
the daily business of education, through which our changed stu- 
dents and circumstances are being accommodated. These daily 
transactions are the 4 4 basic processes" that must be understood 
and better managed to improve learning in today's higher 
education. 

A Framework of Decisions That Affect 
Learning and Retention 

Context evaluation is the most basic type of evaluation, be- 
cause it is concerned with providing a logical rationale for 
choosing educational objectives. Concerned with the total rele- 
vant environment, context evaluation describes the contrast be- 
tween 11 . . . desired and actual conditions . . . identifies 
*' . . . unmet needs and unused opportunities/' diagnoses 44 the 
problems that prevent needs from being met and opportunities 
from being used . . . and provides an 44 . . . essential basis 
for developing objectives whose achievement results in program 
improvement" (Stufflebeam 1971, p. 2l8). Evaluations should 
account for a variety, not just a few, of student input variables, 
institutional variables, program variables, and outcomes 
(Roueche and Snow 1977, pp. 104-1 1). 

Which aspects of the institutional context are relevant and 
important for improving learning and retention? Applying Stuf- 
flebeani's concept to thejjrogram planner's effort to increase 
students' success, the boundaries of the system being evaluated 
must include policies and practices in the * 'regular" program as 
well as practices of the remedial/developmental program. In the 
evaluation of a remedial/developmental program, the concurrent 
analysis of relevant features in the overall instructional pro- 
grams and policies for freshmen would develop a basis for 
change within the total experience for freshmen. Better deci- 
sions about institutional and 4 'regular" courses and about fea- 
tures of developmental programs would be likeiy to follow such 
an analysis. 



Raising Academic Standards 13 




The recurring daily decisions that educators make about in- 
struction, programs, services, and policies comprise the context 
for learning in a college or university. Could a framework of 
these daily decisions be used to analyze institutional data and to 
clarify future possibilities and the desirable intermediate steps 
for improving learning? What are the critical decisions that af- 
fect how much students learn in today's colleges and univer- 
sities? + 

Changing circumstances for higher education have produced 
a different institutional context and role for learning improve- 
ment programs. Old assumptions and methods are inadequate. 
New values and criteria are implicit in this changing context, 
and they call for new definitions of success for remedial/devel- 
opmental programs. 

How are the resources of learning improvement programs 
most effectively used within a college to improve students' 
overall learning and retention? Does research evidence support 
the continued use of separate skills courses to teach generic, 
basic skills that students can then transfer to other courses? 
Does evidence encourage the use of developmental program 
models that integrate developmental resources and activities 
into the regular academic courses? 

Many research studies of the 1960s and 1970s were more 
broadly conceived and more comprehensive than the earlier and 
smaller studies had been. The comprehensive studies of those 
decades were better financed as well, because they were more 
often a central concern of college administrators themselves and 
were ofterf undertaken to fulfill federal or state requirements 
(see Donnovan 1977; New York State Education Department 
1977). The findings from such studies provide a vast store of 
practical information that is obscured by too much attention to ~ 
terminal outcomes alone. 

The focus in this analysis of the data is to identify program 
features that were associated with improved GPA and retention 
and theoJo determine what, if any, patterns emerge. The avail- 
ability of many diverse and comprehensive studies has made this 
analysis-possible, because the studies provide a considerable base 
of qualitative information about many different aspects of col- 
leges' instructional practices, information that was excluded from 
earlier studies and is often overlooked in analyses that consider 
only outcomes related to GPA. 



Characteristics of Successful Programs 

When the success of remedial/developmental programs is mea- 
sured by indicators of overall academic performance and persis- 
tence, the successful programs, despite many other differences, 
have certain characteristics in common. Although conclusive 
evidence is not available, successful programs have two broad 
characteristics in common: (1) comprehensiveness in their sup- 
port services and (2) institutionalization of the developmental 
programs and goals into the academic mainstream. 

Successful remedial/developmental programs offer compre- 
hensive support services and have the flexibility to meet a wide 
variety of individual students* needs and 10 personalize the aca- 
demic experience (Barshis 1979; Maxwell 1979; Donnovan 
1977; Roueche and Snow 1977; New York Siate Education De- 
partment 1977. 1980; Cross 1976; Rossman. Astin. et al. 1975; 
Baehr 1969; Bridge 1970; Christensin 1971; Losak and Burns 
1971; Smith 1972; Gordon 1975). Curricula are adjusted in the 
planning of academic courses, and tutorial support, remediation 
where necessary, and ongoing counseling and social and psy- 
chological support are provided (Renner 1979; Ludwig 1977; 
Jason et al. 1976; Gordon 1975; New York State Education 
Department 1977. 1980; Davis et al. 1973; McDill et al. 1969). 

The individual is emphasized in a positive, person-centered en- 
vironment that fosters self-concept (Barshis 1979; Roueche and 
Snow 1977; Donnovan 1977). Successful programs employ a de- 
velopmental philosophy of instruction (Walvekar 1981. p. 21). 

Successful programs are integrated into the academic and 
social mainstream, avoiding the punitive, low-status overtones 
and the "you cure them" mentality connoted by isolation 
within a separate remedial component (Maxwell 1979; Gordon 
and Wilkerson 1966: Donnovan 1977: Obler et al. 1977; Grant 
and Hoeber 1978; Fincher 1975; Sherman and Tinto 1975). In 
^successful program, the developmental program is institution- 
alized into the college and given the status of division or de- 
partment (Grant and Hoeber 1978; Roueche and Snow 1977). 
The college administration thus demonstrates commitment to 
developmental goals and creates a highly visible testing ground 
for innovative efforts. The learning improvement program 
maintains a close working relationship with academic areas, a 
factor associated with success in four-year colleges (New^York 
State education Department 1980; Roueche and Snow 1977). 
In' this way. all college support services can be coordinated. 
Comprehensive course designs that integrate tha development 
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of basic skills into regular course content are associated with 
su,-ess (Renner 1979; Ludwig 1977; Carter 1970; Shaughnessy 
1977; Bfergman 1977; Ffshman and Dugan 1976; Schiavone 
- 1077). 

The specific features of learning improvement programs 
(such as clearly articulated goal statements and systematic in- 
struction) that various collet use to achieve comprehensive 
student support and an institutionalized developmental philoso- 
phy of instruction are clearly "very important. (The complete list 
of research-validated features is discussed in the following sec- 
tions.) The composite result of whatever specific program fea- 
tures have been deployed, however, is an instructional program 
that meets a greater or a lesser number of students' needs and a 
developmental concept that is more or less institutionalized into 
the academic mainstream. It is these two dimensions, however . 
they have been achieved, that make the difference in how much 
students learn. Colleges that meet a greater number of students' 
individual learning needs and integrate the developmental con- 
cept and practices into their overa'l academic program obtain 
better learning and retention outcomes for their students. 

Characteristics of Less Successful Programs 

Just as successful programs share certain characteristics, less 
effective programs, which fail to improve overall learning and 
persistence, have certain characteristics in common: an empha- 
sis on remedial courses, a lack of systematic support services, - 
and a lack of institutionalization. 

Isolated remedial courses did not make a difference in stu- 
dents' overall success or retention and were the least effective 
of all remedial efforts (Berg and Axtell 2968; Klingelhofer and 
Hollander 1973; Bynum et al. 1972; Grant and, Hoeber 1978). 
Traditional remedial courses seem "relatively ineffective" but 
are suitable for targeted remediation based on specific identified 
needs (Roueche and Snow 1977; Gordon 1975). Most students 
resent remedial courses; they perceive them as a rehash of ear- 
lier schooling and a delay Tor their other study (Finchcr 1975). — 
More of the same cannot and will not succeed (Shaughnessy . 
.,1977; Grant and Hoeber 1978). 

The impressive gains often recorded in remedial courses do • 
not seem to hold up past the semester including the course 
(Trillin and Associates 1980). Success in remedial course work 
does not readily transfer to traditional academic disciplines. 
Away from the remediah instructor's influence and back in the 
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traditional academic environment, students revert to their old 
habits. Most attempts to change human behavior are suspect 
when subjected to rigorous analysis and evaluation (Fincher 



For disadvantaged students, the hours of tutoring and coun- 
seling intervention are positively correlated with GPA (Brah- 
man and McGowar 1976). When systematic support services 
are not available, students receive less tutoring and counseling. 
Learning improvement programs in which systematic support 
services are not used tend not to improve students' overall aca- 
demic performance (Gordon 1975). 

Remedial/developmental programs outside the academic 
mainstream arc ineffective. They lack clear goals or have goals 
incompatible with the institution's goals, 4 4 in essence ... 
neglecting to address the issue of systematically changing the 
structure bf the institution" (Sherman and Tinto 1976, p. IS). 
Unsuccessful programs operate as appendages, without a theo- 
retical base, separate from the institution (Gordon 197S; 
Fincher 1975). 

Remedial/developmental programs are failing because they 
have not yet found the right solutions to the problems involved 
(Fincher 1975; Gordon and Wilkerson 1966). Practitioners in. 
the field do not agree as to how, When, and where develop- 
mental efforts should be organized. The most common ap- 
proaches to learning improvement programs are precollege 
summer programs,' concurrent first semester programs, and 
"vestibule" or "holding" colleges where deficiencies must be 
corrected (Grant and Hoeber 1?78, p. 19). These courses and 
programs are usually designed to prepare students for the in- 
flexible, traditional curriculum. Institutions refuse to see them 
as an indication that the institution's entire curriculum may 
need revision (Newton 1982; Grant and Hoeber 1978). 

Lacking, an instftutionwide developmental purpose and ratio- 
nale, learning improvement programs fail to effect the long- 
term changes in the institution's responses and in students' be- 
havior through which long-term gains in academic learning and 
persistence are made. The evaluation of students' achievements 
in less successful programs, focused narrowly on the practices 
of the isolated developmental program, does not develop the 
problem-solving dialogue with other program managers and 
faculty, through which the institution's procedures might be 
changed, nor does k develop an institutional information base 
and theory of successful practice. 
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Making the Transition from Existing to Improved Programs 

For students in college today, the Carnegie Council (1980) rec- 
ommends (among others): 

. . . education that teaches the skills of reading, writing, 
arithmetic, speaking, problem solving, "crap detecting" (in 
identifying the drivel, exaggerations, and untruths that we 
hear and read each day). . . . These skills are critical for a 
generation raised on the media, weak in the three 
R's . . . (Levine 1980, p. 131). 

The education thus described is not conceptualized as one in 
which basic and cognitive skills are assumed to have been de- 
veloped before college; rather, they are developed within it and 
through it. Students' needs are thought of, not as individual de- 
ficiencies, but as acculturated characteristics developed in re- 
sponse to unfortunate and damaging circumstances of society. 
(See Levine 1980, chaps. 6 and 7, for an insightful discussion 
of contemporary society and its impact on young people.) 

A basic principle in the design of instruction is to begin at a 
level consonant with students' backgrounds of already acquired 
prerequisite knowledge and skills. The affirmation of this prin- 
ciple in the proposals of recent policy commissions for higher 
education and in the research on learning improvement has 
enormous implications for the design of both academic and 
learning improvement programs for today's underprepared col- 
lege population. 

Yet existing programs, policies, and staffing cannot be dis- 
carded or reformed by decree. We must understand what deci- 
sions foster gradual change in regular college programs, how 
consensus for these changes can be achieved among an inde- 
pendent and traditional faculty who are oriented primarily to 
their own disciplines and who may not be informed about the 
methods or the urgency to improve learning, and what specific 
changes and activities have been demonstrated to promote 
learning. The Decision Guide tor Effective Programs is a tool 
for the practitipner, an aid tjiat provides accurate information 
about what works to improve learning and the most practical 
first steps toward achieving better instruction. 

Possibilities are as important in the Decision Guide as the 
historical record of what has worked to improve learning. The 
comprehensive set of possible choices within each type of deci- 



sion provides not only the ideal choice but also the effective 
intermediate and increniental choices that can be made until 
consensus for greater change is achieved. The annotated re- 
search findings that justify the ranking of choices provide a 
quick summary of the data as well as the reference where more 
detailed information can be obtained if it is desired. A very 
productive use of the Decision Guide is as a model for the col- 
lection and interpretation of in-house data, which can then be 
used to increase awareness of the need for learning improve- 
ment and f.o develop an institutional rationale and experiential 
basis for change. 
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THE DECISION GUIDE FOR EFFECTIVE PROGRAMS 



Two inseparable values underlie the ranking of programs and 
possible decisions within the Decision Guid<? for Effective Pro- 
grams: their demonstrated potential for improving learning in 
the overall academic program and their potential for bringing 
about gradual change toward the use of more responsive meth- 
ods in academic courses. These rankings reflect the analyses 
and conclusions of countless diverse research studies in which 
GPA was a measured outcome. They also reflect the emerging 
consensus that traditional postsecondary instruction must 
change to promote genuine learning in today's higher education 
environment (Cole 1982; Newton 1982; McCabc 1981; Levine 
1980; Carnegie Council 1979, 1980; Carnegie Foundation 
1977; Trillin and Associates 1980; Cross 1976, 1979; Maxwell 
1979; Roueche and Snow 1977). 

The interdependence of these two values— improved learning 
and changed instruction— is the central message of the research 
literature. How to obtain these values in a college or university 
is the central message of the Decision Guide for Effective Pro- 
grams. The Decision Guide is a plan for our time— a time 
when learning improvement is an urgent necessity, a time when 
improvements must come from the more effective use of exist- 
ing resources rather than from major new initiatives. 

The Hierarchy of Learning Improvement Programs 

The organizational structure of the learning improvement pro- 
gram extends or limits its effect on achievement and retention 
more than any other single characteristic of the program. The 
mechanisms that operate to make this statement true and the 
four commonly used types of programs are described in Figure 
I . the four types of programs are differentiated by the extent 
to which they provide comprehensive support services to meet 
a bload spectrum of students' personal learning needs and are 
inst tutionalized into the academic mainstream of the college or 
university. Within the Hierarchy of Learning Improvement Pro- 
grams, the higher level programs include each of the lower 
leve| program structures plus additional features that achieve 
greater (I) comprehensiveness and (2) institutionalization. 

Levi 1 1 programs: Remedial courses 

Separate remedial basic skills courses are historically the most 
v. idejly used structure for learning improvement programs. This 
program structure is based on two assumptions: (I) The student 
has 1 deficit (such as a lack of writing ability or a bad attitude) 
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Figure 1 

The Hierarchy of Learning Improvement Programs 



High potential for improved 
learning and instructional change 




Low 



that interferes with college learning; when the deficit is over- 
come (in the remedial course), the student will succeed; 
(2) Skills such as critical thinking, reading, problem solving, 
and quantitative reasoning can be developed as generic sk;lis in 
separate courses; students will then transfer these new skills to 
other applications in other courses. 

Neither of these assumptions is supported by the research lit- 
erature for the students who need remediation in college. It is 
increasingly recognized that generalized approaches to remedial 
and tutorial assistance are less likely tote effective than those 
targeted at specific aspects of learning within the academic 
courses in which the need for the knowledge or skill becomes 
apparent (Gordon 1975). 
— Separate remedial, basic skills courses are at the lowest level 
in the Hierarchy because they are the least likely to effect long- 
term academic achievement and persistence and because they 
tend not to foster the shared problem solving (with other fac- 
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ulty and counselors) that leads to providing improved and more 
responsive learning environments in the regular academic 
program. 

Level II programs: Learning assistance for individual students 
Learning assistance for individual students is based upon the 
assumptions that (1) the student has the problem and therefore 
must seek the solution; (2) students can overcome deficiencies 
through independent study and tutorial assistance; (3) personal 
attention helps to counter low self-esteem and poor study habits 
and will enable students to overcome academic failure. Learn- 
ing as^stance centers and various tutorial services came into 
widespread use in the 1960s and 1970s. Students who sought 
extra help could obtain it through a center; some tutorial pro- 
grams assigned high-risk students to peer counselors. 

Learning assistance for individual students offers many advan- 
tages over isolated remedial courses. The advantage to students is 
that they receive help directly with.their academic course work, in 
informal situations that provide ongoing social and psychological 
support as well as instruction. Course instructors may refer stu- 
dents for assistance and may seek out developmental instmctors to 
discuss the learning problems of their students. When these con- 
tacts occur, developmental program personnel have the opportu- 
nity to obtain firsthand knowledge and insight into institutional 
practices and problems, knowledge that can then be used to build 
support for more effective services. 

Learning assistance for indi\ idual students comprises Level 
11 of the Hierarchy of Learning Improvement Programs be- 
cause, when established in addition to instruction in basic 
skills, the likelihood increases that some students' atypical 
needs will be met and their learning improved. Assistance to 
students with their academic course work is an important com- 
ponent of college learning improvement programs, because it 
can be a developmental planner's first step out of the narrow 
confines of a separate program toward more comprehensive and 
better coordinated services and the academic inshuctor's first 
step toward creating a more responsive classroom environment. 

Learning assistance 'o individuals is not effective as a total 
program, however. Tutorial assistance to individuals, when it is 
the only service, is the least successful for students' overall 
success because it fails to address students' very real weak- 
' nesses in knowledge and skills (Cross 1976). Such informal or 
•walk-in" learning assistance has several major disadvantages: 
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(I) it is not systematic; (2) it tends to be used too little, tj>o 
late: (3) it happens after a failure has occurred rather than ear- 
lier to prevent the failure (Grant and Hoeber 1978); and (4) it 
usually is avoided by the students who need it most. 

Level Hi programs: Course-related learning services 
Systematic coordination of developmental objectives and activi- 
ties into academic course assignments distinguishes the Level 
111 programs from the lower level programs. Ail the students 
within a given class or course have the opportunity to partici- 
pate in the supplementary activities. 

The assumption in Level 111 programs is that the college 
must provide whatever extra instruction is necessary to bridge 
the gap between students' skills and knowledge at entry and 
those required to master the course material. The principles of 
mastery learning may also be the underlying'philosophy behind 
supplementary instructional opportunities to ensure that appro- 
priate learning occurs. Students' learning needs are presented as 
being necessary because of the nature of the objectives and 
content of the course rather than because of students' deficien- 
cies. Therefore, all students have access to supplementary, pos- 
sibly innovative, instructional experiences, which benefit 
nonrcmedial students as well (Gordon 1975). 

In a Level 111 program, adjunct learning experiences for re- 
view, reinforcement, and/or reteaching of selected requisite top- 
ics are integrated into the ongoing requirements for the course. 
Through a variety of assignments, including media, tutorial, 
and small-group learning experiences, students receive addi- 
tional directed instructional time with important course content. 
They may have to demonstrate competency as well. Mastery 
learning technology, in which students practice and restudy un- 
til they demonstrate mastery, is particularly suited to Level 111 
model programs. It is the most effective of the single develop- 
mental components for achieving academic success for the un- 
dprprcpared student (Cross 1976). 

The trend in colleges is to replace traditional reading and 
study skills programs with learning centers. The learning center 
has three functions: service to students, training of teachers, 
and research and program development (Maxwell 1975). The 
feature that distinguishes Level 111 from Level 11 [earning cen- 
ters is the link of services to specific academic courses en Level 
III. Through this link, faculty receive help both for students 
With needs that faculty are ill-equipped to handle and with the 
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extremes of diversity that have increased the instructor's work- 
load (Cross 1976). 

Lower level components have important roles in Level 111 
programs. Lower level "walk-in" learning assistance leads to 
problem-solving interaction among students, academic faculty, 
and developmental personnel for learning objectives presently 
outside the course-related service. The learning assistance cen- 
ter thus becomes a laboratory for experimenting with more suc- 
cessful instruction (Manzo 1979) and a proving ground for 
innovations that can lead to more systematic and effective 
higher level services. 

In a coordinated learning services program, the basic skills 
courses are designed to develop specific skills for a relatively 
smaller population of students, who are assigned to the courses 
on the basis of diagnostic placement tests. Skills courses arc 
appropriate for the student whose needs arc too pervasive to be 
met entirely in the course-related supplementary support com- 
ponents of the program. For example, students who need to re- 
learn many operations in arithmetic should take the basic 
course, whereas students who need to review only percents can 
do so through learning experiences that are a part of the sylla- 
bus of a chemistry, nursing, or accounting course. 

Level IV programs: Comprehensive learning systems 
Different both in scope and precept from lower level programs, 
comprehensive learning system*; provide for the total learning 
needs of all students through more sophisticated and complex 
methods than the reinforcement technology applied in Level HI 
programs. Learning processes for the course or curriculum are 
purposefully designed with students' particular needs and atti- 
tudes in mind. The instructor does, not merely dump informa- 
tion on an unknown student audience. Rather, the instructor 
uses a variety of resources and techniques to maximize stu- 
dents' involvement with the course and their commitment to 
learn. 

In Level IV programs, the assumption is that the total educa- 
tional experience within the course should be systematically de- 
signed according to the principles of learning theory. The 
student's overall developmental needs are provided for, includ- 
ing interpersonal and affective needs and cognitive and requi- 
site skills. The instructor monitors students' responses 
(including learning) and adjusts teaching strategies and learning 
experiences individually. 



: . <£- 

The design of such instruction embodies several important 
concepts. Colleges can be educationally effective only if they 
reach students where they are, only if learning is made relevant 
to students' central concerns, and only if the three personal 
competencies (intellectual competence, physical-manual skills, 
and interpersonal competence) are developed as part of a whole 
(Chickering 1969). Time, rather than achievement, should be 
the variable in education. Students differ in the amount of time 
needed for learning; by increasing time spent on a task, stu- 
dents can learn a given content to specified criteria (Grant et al. 
1979) 

Developmental theorists such as Brunei*, Erikson, and Piaget 
proposed hierarchical, cross-cultural, predetermined sequences 
in die growth or maturation of abilities. A "critical period" is 
the time when an individual is most ready for a "task-relevant 
experience" to help facilitate his or her development, 'inter- 
vention" with the appropriate learning experience at the critical 
time promotes maximal learning (Roueche and Snow 1977, p. 
13). Other significant teaching methodologies include cognitive 
behavior modification (Killian 1980; Sadler and Whimbey 

1979) , inquiry teaching, problem solving (Whimbey and Lock- 
head 1981; Ozer 1980), Piagetian learning cycles (Killian 

1980) , and reading in the content areas. 

A comprehensive, instructional system is synthesized out of 
conventional instructional practices and developmental learning 
theory, guided by die practical experience of what works best 
for given students in a particular course. A comprehensive sys- 
tem includes whatever content, personal growth, and learning 
activities students need to accomplish the objectives of a 
course, merged into a coherent and unified instructional pro- 
gram using personalized course and instructional support activi- 
ties (Newton 1982, p. 42). 

Comprehensive programs represent the highest level in the 
Hierarchy of Learning Improvement Programs because they are 
most likely to improve students' learning and to effect change 
in academic instruction. Comprehensive systems are best 
evolved out of the experiences derived from lower level pro- 
grams for three reasons: (1) the lower level support components 
must be in place to provide auxiliary learning experiences for 
the courses; (2) the experience that developmental and regular 
instructors obtain in implementing lower level services provides 
planners with the knowledge and confidence they need to estab- 
lish comprehensive systems; (3) continued, quiet, incremental 
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change is more likely to occur and be accepted than massive 
reforms undertaken all at once (Levine 1978, p. 420). 

Relatively few Level IV programs, compared to the number 
of remedial course programs, are described in the research liter* 
aturc. Early holistic attempts involved team teaching to achieve 
the fusion of instruction in reading/study skills into history/ 
social studies courses and an engineering physics course (Dia- 
mond 1976; Shaw 1960). A recent structure is the back-to-back 
reading/content course, sometimes called "piggybacking/' All 
students in an academic course are enrolled in the parallel read- 
ing course, in which text and course materials are used to de- 
velop mature reading abilities (Moran 1980; Bergman 1977). 

"Block programs*' at the Community College of Allegheny 
County (Pennsylvania) are multidisciplinary courses incorporat- 
ing reasoning, reading, writing, speaking, or mathematics in- 
struction into an academic course such as social studies, which 
meets for expanded hours of time (Holmberg et al. 1979). 

The Loop College (Chicago) program is a holistic system of 
block courses and a full range of support services for individ- 
ualizing instruction? including peer tutoring and audiovisual in- 
struction (Barshis 1979). 

At the University of New Mexico, freshmen below certain 
levels are placed in social studies or natural sciences courses of 
their choice designed primarily to raise students' ability to read, 
analyze, and evaluate the materials of the discipline. In these 
courses, the goal of developing generic cognitive skills is con- 
sidered more important than learning content (Minnick and Tei- 
tclbaum 1980). An individualized social studies instructional 
program at Cuyahoga Community College (Ohio) has been suc- 
cessful in raising students' cognitive levels of operation in pro- 
cessing the content of the course (Ludwig 1977). 

At Southern Illinois University, as part of the Acceleration 
Program in Science and Technology for disadvantaged students, 
the quasi-modular approach (QMA) is used for the teaching of 
remedial and precalculus mathematics.. QMA is a comprehen- 
sive learning system that coordinates counseling and .tutoring, 
with conventional lectures that have workshops built in. The 
early courses in die acceleration program comprise an alterna- 
tive educational system founded on cognitive and affective sup- 
port systems (Jason et al. 1976). 

In practice, the distinction between Level III and Level IV 
programs blurs somewhat, because real programs often contain 
a mixture of elements from both levefr. The Loop College pro- 




gram, for example, is totally a Level IV program, able to re- 
spond to the whole gamut of inner-city students* needs through 
a highly personalized system of support. QMA is also fully 
comprehensive for students* cognitive and emotional develop- 
mental needs; however, it is targeted only at mathematics. 
Other programs, such as those at the University of New Mex- 
ico and Cuyahoga Community College, apply learning theory 
and systematic course designs to achieve students* language 
and cognitive developmental needs (thereby qualifying as Level 
IV programs) but foster students* affective development only 
incidentally through procedures that may be more characteristic 
of LeveJ II or Level ill programs. The distinction between 
Level HI and Level IV programs is important, however, be- 
cause it provides a meaningful basis for classifying and com- 
paring programs and for designing improved pro-am elements. 

The Hierarchies of Possible Decisions 

Within an existing learning improvement program, whatever its 
structure, instructors and managers make many important deci- 
sions that will affect program outcomes. The possible decisions 
that can be made represent the options that managers can use to 
design services, procedures, policies, and other features of the 
program. However, these options may not exi^t in the institu- 
tion and therefore may have to be created (Stufflebeam 1971), 
or les$ desirable decisions, already operationalized, may have 
to be changed. Decision makers need to know what vari- 
ables in a learning improvement program are associated with 
improved academic achievement and what presently existing 
program features should be analyzed for effectiveness and pos- 
sible modification. 

Important program features 

Certain variables (features) of Seaming improvement programs 
occur frequently in research studies and are repeatedly cited as 
being of central importance in determining the learning out- 
comes described in the stud ; es. Although these variables are 
grouped for convenience around the usual categories of decN 
sions that are made for any program — the goals and rationale, 
the methods and content, the policies and standards, the staff 
and roles, the evaluation process — many of the variables are 
neither widely recognized nor typically used to full advantage. 

Figure 2 lists the variables that researchers have identified as 
being associated with improving learning. Decisions must be 
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Figure 2 

Critical Variables for Learning Improvement Programs 



Goals, Objectives, and Rationale for Instruction 

1 . Developmental program goals 

2. Perceptions of institutional responsibility 

3. Methods for choosing instructional objectives 

4. Rationale for learning services * 

5. Compatibility of developmental goals with regular 
program and institutional goals 

6. Attitude toward nontraditional students 

7. Structure of the developmental program 

Instructional Methods and Content 

8. Methods of instruction 

9. Responsiveness to students 

10. Development of cognitive and basic skills 

1 1 . Affective development of students 

12. Control for learners success 

i 

Institutional Policies and Standards 

13. Directing students into appropriate courses and programs 

14. Definition of competencies in academic courses 

15. Credit earned for remedial .developmental study 

16. Systematic procedures for advisement 

17. Organization of the developmental program within the 
college 

18. Institutionalization of developmental services 

Professional and Paraprofessional Staff and Roles 

19. Regular course instructor's role 

20. Developmental program staff.and-role 

21 . Counseling staff and role 

22. Faculty and staff development 

Evaluation of Learning Improvement Programs 

23. Institutional context and outcomes 

24. Student outcomes 

25. Academic standards and the grade point average 

26. Ongoing evaluation 




made about each of them. Therefore, these variables comprise 
a comprehensive list of the critical factors in the design of a 
remedial/developmental program. Decisions about these features 
distinguish various programs, are likely to affect their suc- 
cess, and therefore will be most productive as starting points for 
die analysis and redesign of a particular instructional program. 

Ranking the possible options 

In the Hierarchies of Possible Decisions, the decisions that can 
be made about each program variable are summarized and 
ranked according to their probability of effecting positive 
change in students' overall achievement and instruction within 
the college. In the aggregate, these decisions comprise a com- 

- prehensive list of the options from which educators can select 
the most facilitative combination of program features for a par- 
ticular situation. 

The four levels of alternative decisions for each variable pro- 
vide general parameters rather than specifically defined alterna- 
tives for the choices available. Level IV decisions rank high on 
the Hierarchies because they enhance long-term overall learning 
and because they facilitate evolutionary instructional change; 
Level 1 alternatives r^nk low because they are least likely to 
obtain positive overall. effects. The levels in between suggest 
increasingly desirable alternatives, as measured against the val- 
ues of greater learning and change being sought from learning 
improvement programs today. The levels are intended to sug- 
gest a continuum of possible variation on the dimension 
being considered for decision rather than fixed, precisely de- 

-fined. limits. 

The! most comprehensive, institutionalized, ideal alternative 
• for each decision would of course be ihe Level IV decision. 

"However, it is usually not practical, prudent, or possible to at- 
tempt! to initiate learning improvement programs with all Level 
' IV options. In reality, a college learning improvement program 

usually includes activities and features from each level; support 

for one academic division may be course-related and systematic • 

and for another may be on an unorganized walk-in basis only 
•or nonexistent. J t takes years of shared experiences within a 

college to know which practices should be institutionalized and 

to achieve consensus for doing so. Colleges should initiate new 

programs with primarily remedial components until institutional 

experience and knowledge lead to evolving more complex pro- 
gram features (New.Yock State Education Department 1977). 

j i r 
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An extensive body of research supports the values implicit in 
the Hierarchies and the relative superiority of certain program 
features over ethers for obtaining these values. Comprehensive 
studies have been made of multiple programs in which compar- 
ative analyses of program elements and effects have been ob- 
tained (see,, rfbr example, Simmons et al. 1979; Grant and 
Hoeber 1978; New York State Education Department 1977; 
Donnovan 1977; Roueche and Snow 1977). Researchers of in- 
dividual programs have also specified elements associated with 
the success of a particular developmental program. Therefore, 
certain variables have been validated to be associated with stu- 
dents* long-term academic improvement and retention in a large 
number of two-year and four-year institutions; they are included 
in the Hierarchies. 

Conclusive prbofs are not available, however. Researchers 
have far more evfdence about what does not work in the long 
term (isolated remediation) than proof of what does because of 
the past emphasis on remedial programs and the less frequent 
use of integrated, comprehensive ones. It may also be true that 
the best instructional systems have subsumed the developmental 
concept into a focus that* is entirely on students' learning of the 
content (engineering, for example) and thus may not be recog- 
nizable as developmental programs (Simmons et al. 1979). 




The Hierarchy of Decisions Relating to Goals, 
Objectives, and Rationale 

Successful learning improvement program's are foCmded upon 
statements of rationale and goals that define the specific needs 
and problems that the learning improvement program should 
address as institutional missions. Instead of "You (the 
remedial/developmental staff) must solve these problems," the 
approach is, "Our studeqts need these things. How can we best 
help them learn?" Local institutional dgta are interpreted in the 
light of the relevant general issues within" today's higher educa- 
tion environment. Institutional concerns and problems are more 
understandable and fewer hackles are raised when it is apparent 
that nearly every college and university i& struggling with the 
same problems. Local data and problems become the basis for 
dialogue among faculty/departments, and committees at all 
levels in the college. Through this dialogue, 'appropriate ratio- 
nal^, goals, and objectives are chosen — for academic programs 
as well as for the developmental program. 
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Figure 3 contains the decisions relating to goals, objectives, 
and rationale that researchers have identified as having impact 
on the success of learning improvement programs. The vari- 
ables are: 

1. developmental program goals 

2. perceptions of institutional responsibility 

3. methods for choosing instructional objectives 

4. 'rationale for learning services 

,'• 5. compatibility of developmental goals with regular 
program and institutional foals 

6. attitude toward nontraditional students ^ 

7. structure of the developmental program. p 

* * * 

Variable 1. developmental program goals 
Goals are imprecise, poorly thought out, and not specified in 
many programs, which as * consequence are haphazardly im- 
plemented and impossible to evaluate (Sherman and Tinto 
1975). Goals should include both short-range and long-term 
student-centered, staff-centered, program-centered, and institu- 
tional outcomes (New York State Education Department 1977). 
Expectations for students may range from providing equal op- 
portunity to providing a little better chance (Grant et al. 1979). 

Level I decisions. Emphasizing the short-term goal of students' 
achieving readiness for college work (Minnick and Teitelbaum 
1980), objectives for the remedial program concern the develop- 
ment of basic skills, playing ^catch-up" (Webb 1977). 

Level It decisions. Goals are established for individual students. 

Level 111 decbions. Certain shared developmental ard aca- 
demic program objectives are specified to be accomplished in 
supplementary learning experiences, which are presented as 
part of trce ongoing life of the course. 

Level IV decisions. Comprehensive goals include all students, 
all learning encompassed by the course, and relevant staff and 
programmatic outcomes for both the developmental and regular 
programs. Long-term and short-&mi developmental program goals 
are established for students, staff, program, and instruction. 

Variable 2., Perceptions if institutional responsibility 
In the past, at&nuon was given to creating conventional stu- 
dents out of disadvantaged ones. Now it is more generally per- . / 
ceived (a* occasionally noted earlier— -Gordon and Wilkerson ' 
1966) that the more central problem is ;o reconstruct the educa- / 
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Figure 3 The Hierarchy of Decisions: 

Variables 
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Developmental 
Program Goals 


Perceptions of 
Institutional 
Responsibility 


Methods for 
Choosing 
Objectives 


Include Mong- 
and short-term 
goals for aca- 
demic and de- 
velopmental 
programs, stu- 
dents, staff, 
and institu- 
tion. 


Accept that 
the college 
should adapt 
regular in- 
struction to. 
meet the 
needs of all 
admitted stu- 
dents. 


Base choice 
on applied in- 
stitutional re- 
search into 
learning sta- 
tus, course re- 
quirements, 
students* 
needs. 


Include spe- 
cific, course- 
related objec- 
tives. 


Acknowledge 
the need to 
provide sys- 
tematic sup- 
port for some 
objectives 
only, in exist- 
ing courses. 


Base choice 
on systematic 
analysis of 
some class 
tests or work. 


Include goals 
primarily for 
individual stu- 
dents. 


Limit col- 
lege's respon- 
sibility to 
making extra 
help available. 


Teach stan- 
dard 'develop- 
mental content 
or course ma- 
terial that stu- 
dent requests. 


Specify goals 
in terms of 
students' gen- 
eral readiness 
for college 
work. 


Perceive col- 
lege's respon- 
sibility only to 
admit atypical 
students. Ac- 
cept high at- 
trition as 
inevitable. 


Teach stan- 
dard develop- 
mental 
content. 



Relating to Goals, Objectives, and Rationale 

/ 

Variables 



Rationale for 
Learning 
Services 


Compatibility 
of Goals 


Attitude 
toward 
Students 


Structure of 
Developmental 
Program 


Focus pro- 
gram on pos- 
sibilities and 
needs to know 
within curric- 
ulum unit. 


Link develop- 
mental goals 
to college's 
mission state- 
ment. Use 
committees to 
negotiate de- 
velopmental 
concept into 
other pro- 
grams' goals. 


Accept all ad- 
mitted stu- 
dents non- 
judgmentally, 
with positive 
expectations. 


IV 

Comprehensive 
Learning 
Systems 


Focus pro- 
gram on pre- 
requisite 
objectives 
with known 
criteria for 
exit or com- 
petency. 


Create aware- 
ness of pro- 
gram-specific 
needs; articu- 
late develop- 
mental/ 
academic pro- 
gram goals. 


Accept some 
students as 
necessary to 
populate pro- 
grams; up- 
grade their 
skills as 
needed. 


III 

Course-related 
Learning 
Services 


Base program 
on student's 
deficiencies or 
problems in 
academic 
courses. 


Negotiate de- 
velopmental 
objectives 
with individ- 
ual students 
and faculty. 


Let the stu- 
dent obtain 
help to solve 
his own prob- 
lem. 


II 

Individual 
Learning 
Assistance 


Base program 
on students' 
deficiencies 
on basic skills 
tests. 


Accept "re- 
medial" status 
and goals in 
an unyielding 
traditional 
college. 


Isolate unfit 
students until 
deficiencies 
are reme- 
diated. 

i 


I 

Remedial 
Courses* 



tional system so that college is a useful experience for most 
young people (Kendrick 1969). The responsibility of the col- 
lege is to educate admitted students, whether qualified or not 
(Simmons et al. 1979). The university rieeds to redefine its role 
in society and its responsibility for the education of all stu- 
dents, whether or not they fit the traditional image (Gordon 
1975). American education may be judged historically by its 
success in educating! the disadvantaged (Fincher 1975). 

Level I decisions. ^The college provides easy access with a 
standard remedial program and accepts very high attrition when 
(as is often the case) ptudents do not make a successful transi- 
tion to the regular program (Roueche and Snow 1977). 

Level II decisions. The college defines its responsibility in 
terms of making extra help available to individual students. 

Level HI decisions. The college acknowledges its responsibil- 
ity to provide developmental support for some objectives. Be- 
cause it is always easier to add an extension than to restructure 
the mainstream educational experience (Gordon 1975), the sup-, 
port is supplementary though coordinated within the ongoing 
academic course. Leadership and resources are provided to de- 
velop consensus for more basic instructional change. 

Levt! : V decisions. Leadership and resources are expended on 
comprehensive institutional and programmatic adaptations of the 
instructional program to meet the full range of students* needs. 

Variable 3. Methods for choosing instructional objectives 
Faculty are ill-equipped to deal with the diversity of students in 
their courses (Simmons et al. 1979; Cross 1976). Faculty must 
learn new methods of teaching, testing, and thinking (Grant et 
al. 1979). Developmental specialists have a special role in 
helping faculty develop ne|v abilities (Grant and Hoeber 1978) 
and in providing information obtained through local institu- 
tional research projects about students* status and learning 
needs and about effective approaches (Maxwell 1975). 

Level I decisions. Students are taught traditional college 
preparatory courses in isolated remedial settings. 

Level II decisions. Students are helped individually with rou- 
tinely assigned, possibly entirely inappropriate (for them), aca- 
demic course work or with standard remedial work selected 
from traditional college preparatory courses. . 

Level III decisions. Based on systematic analysis of selected 
class tests or work, developmental support for some objectives 
is provided through the academic course. Insight about stu- 




dents' learning needs is used in planning subsequent 
instruction. 

Level IV decisions. Comprehensive revisions to the course 
and curriculum are based on local research findings and provide 
a full range of appropriate learning activities to develop the 
content of the course. Textbooks are selected for understanda- 
bility. (Fifty-eigb*lpercent of engineering faculty considered 
this factgpiifiportant in the success of students, reported Sim- 
Iset al. in 1979.) 

Variable 4. Rationale for learning services 
An institution reveals its attitude toward students in the title it 
selects for its basic skills program. A choice of "remedial" 
(implying blame) versus "developmental" (implying learning 
sequences or stages) is an ideological issue. The remedial or 
"deficit" model posits blame on students for lacking certain 
knowledge or skills. It is negative and should be abandoned 
(Cross 1976; Sherman and Tinto 1975). The questions are, 
Who has failed, the student or the educational system? and 
Who should change? (Grant and Hoeber 1978). 

Level I decisions. The remedial component is based on stu- 
dents' deficiencies on basic skills tests. 

Level II decisions. Students' problems in courses are the fo- 
cus of the learning assistance provided. 

Level III decisions. A supplementary basic skills component 
focuses on specific objectives identified within a related course 
or within a follow-on unit or course. Known standards for 
achievement and recognizably important definitions of compe- 
tency favor students' acceptance of the instruction (New York 
State Education Department 1977). 

Level IV decisions. A philosophy of basic skills instruction is 
articulated. Skills are taught as needed and as they are relevant 
to the content of the course, not as they are identified as defi- 
cient in a single test or performance. The rationale that guides 
instruction is one of possibility, not deficiency (Chaplin «. 
1977a). Written statements of the program's philosophy and 
objectives foster success (Roueche and Snow 1977). 

Variable 5. Compatibility of developmental goals 

with regular program and institutional goals 

Are the goals of learning improvement programs accepted by 

the administration? Byother academic program managers? 

Does the college's mission statement reflect a developmental 



Developmen- 
tal specialists 
have a special 
role in 
helping 
faculty 
develop new 
abilities. 
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philosophy of teaching? Many value systems are involved 
(Stufflcbeam 1971): institutional values such as survival, mis- 
sion, growth; external values such as requirements for ac- 
creditation and integrity of disciplines; subsystem values such 
as priorities for programs and curricula; and private, personal 
values and prejudices. The institutional impact of an active, 
successful developmental program includes the shifting of more 
resources to "C" and "D" students, a redistribution of the 
faculty's labor so that more time is spent teaching basic skills. 
Some faculty resist these changes (Grant et al. 1979). 

Level I decisions. Unyielding elitist tradition is at odds with 
developmental philosophy and force? the constraint of ^reme- 
dial" status on the learning improvement program. Most of the 
college reading programs reported in the literature have yielded 
to this constraint, despite the widespread dissatisfaction of read- 
ing specialists with this role (Walter 1979; Chaplin 1977b; 
Carter 1970) and despite the strong theoretical base within the 
literature for reading instruction based on academic course ma- 
terials and content. ^ 

Level II decisions. The faculty beSieve that students should 
not be spoon fed. Developmental staff help individual students 
and faculty as much as possible and use the knowledge gained 
from individual experiences to negotiate shared goals for more 
systematic instruction to meet recurring needs. 

Level III decisions. Local institutional research findings are 
disseminated to increase faculty's and administrators' awareness 
of the need for instructional services and development. If an 
adjunct service is contemplated, the relevance and value of un- 
developed, requisite basic skiUs to course content are demon- 
strated. If the shared developmental-academic goals are not 
wholeheartedly endorsed, they are at least perceived as a means 
of alleviating the pressure of the dilemma of a program's sur- 
vival versus its integrity. • 

Level IV decisions. Developmental program goals reflect die. 
language and intent of institutional mission statements and provide 
a framework for specific program objectives. Administrative pro- 
cesses (the program planning and budgeting cycle, the curriculum 
committee, for example) are used to articulate the developmental 
philosophy. Both short-term and long-term goals are negotiated 
with superiors (New York State Education Department 1977, p. 
75). The highest level services possible are implemented within 
academic areas where goals are compatible. 



Variable d. Attitude toward nontraditional students 
In a survey of 38 engineering school programs for the disad- 
vantaged, 80 percent of the faculty stated that the teacher's sen- 
sitivity is a "most important" programmatic variable for 
students* success, exceeded only by students* motivation (97 
percent) (Simmons et ai. 1979, p. 32). 

The traditional predictors of academic success, test scores 
and high school grades, do not necessarily measure a person's 
potential to benefit from college (Astin et al. 1972). After one- 
half century of research, the most sophisticated psychological 
and statistical methods can account for only 25 percent of the 
change in achievement indexes (Roueche and Snow 1977, 
p. 82). 

Two conflicting purposes present the developmental planner 
with a dilemma. The dissemination of information about test 
scores for individual students is necessary, both to build con- 
sensus for developing instruction and to facilitate faculty's ad- 
vising of individual students. Yet the dissemination of such 
information to elitist or uninformed faculty members risks prej- 
udicing them against the students who most need expressions of 
confidence and support. Researchers suggest three methods of 
resolving this dilemma: 

7. Educate the faculty to the limitations of the Scholastic Ap- 
titude Tests. SATs are not aptitude tests and do not measure 
"capacity for learning," according to Harvard researchers. 
They are just another standardized achievement test and are a 
third-rate predictor of success in college, behind high school 
grades and subject-relevant achievement tests (Slack and Porter 
1980). 

2. Use criterion-referenced testsJnstead of standardized sur- 
vey tests. Criterion-referenced reading tests, constructed from 
the college textbooks being used, are accurate for identifying 
specific instructional needs and for demonstrating learning that 
has occurred (Flippo 1980; Anderson 1973). 

Even students of high ability demonstrate surprising specific 
weaknesses when criterion-referenced tests are used. This use 
of criterion-referenced tests thus helps to prevent the institu- 
tional testing program from embarrassing any one segment of 
the student population. At one typical college, for example, to 
be admitted to the nursing program, incoming freshmen must 
have SAT mathematics scores above 450, which is slightly 
above the national norm. Yet four consecutive years of testing 
for fractions, decimals, percents, and ratios (needed to compute 
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dosages) have shown that approximately one-third of the nurs- 
ing students needed to participate in supplementary instruction 
(Keimig 1982). The national studies of declining skills corrob- 
orate the decline in basic skills among higher ability students as 
well as others (Carnegie Foundation 1977, pp. 212-13). 

3. Develop local norms for whatever tesis are ustd (Maxwell 
1970). Knowjedge about ranking within the institution or the 
tendency cf failure within particular programs to be associated 
with weaknesses of specific skills is far more useful than na- 
tional data and norms. Because such information is more situa- 
tion specific, students are more likely to perceive it as useful 
rather than demeaning (Roueche and Snow 1977). 

The institution's attitude toward students, which tends to be- 
come self-fulfilling, is managed by decisions such as these. 

Level I decisions. Students face self-defeating disparagement 
from other '.udents and negative expectations from faculty, 
which are reinforced by their isolation in remedial programs. 

Level II decisions. The student has the problem and can ob- 
tain help to overcome it if he or she chooses. 

Level ht decisions. Within academic courses, appropriate op- 
portunities for review are provided, albeit begrudgingly, be- 
cause students are needed to populate the programs; to fail to~ 
upgrade their skills would damage the program. 

Level IV decisions. Students are accepted nonjudgmentally, 
with positive expectations for success. When perceived as simi- 
lar to others in the institution, they are more successful 
(Roueche and Snow 1977). Comprehensive instruction provides 
for all learning needs without special designations of support 
components as "remedial." 

Variable 7. Structure of the developmental program 
The organizational structure of developmental programs has in- 
terested researchers since the post-war influx of nentraditional 
college students (Braken 1954; Bliesmer 1956; Gordon 1975; . 
Arkwardy and Chafin'1980; Sanders 1980). Before that time, 
the remedial course model was generally assumed, being well 
suited to the institutional purposes of the time (see McAllister 
1954; Causey 1955, 1956, 1957; Robinson 1965 for descrip- 
tions of early programs. 

The structure of support services has become increasingly 
complex and varied, with the broadening of institutional pur- 
poses for learning improvement programs. Whereas integrated 
services were rarely reported before the 1950s, in recent de- 



cades integrated services have been described more often by 
program evaluators (Arkwaydy and Chafin 1980; Sanders 1980; 
Fincher 1975, for example). 

Research evidence is accumulating to show that integrated 
services providing an immediate link between the need to know 
and the learning experience are the most effective (Trillin and 
Associates 1980; Manzo 1979; Cross 1976). Multilevel, com- 
prehensive services related to regular academic courses allow a 
degree of individualization that is otherwise unattainable and 
can meet the most serious learning needs (Ludwig 1977). Aca- 
demic faculty place high value on the importance of organized 
support services that use structured formats for tutoring and re- 
view (Simmons et aJ. 1979). Similar surveys exist showing fac- 
ulty support for isolated remedial programs in institutions 
where no integrated support services exist (Fairbanks and 
Snozek 1973). In no instance in this extensive review of the 
research, however, was a survey found in which faculty, hav- 
ing both alternatives, rejected coordinated, integrated support 
services in favor of casual assistance or remedial courses. The 
^remedial function of drills in basic skills, however, was consid- 
ered a highly important component, even in the integrated pro- 
grams (Simmons et al. 1979). 

Each Hierarchy of Decisions highlights the developmental 
program structure because its significance outweighs all other 
variables if the developmental program is to fulfill its potential 
role as catalyst and lead the institution to the reaffirmation of 
its teaching mission. When the organizational structure of the 
developmental program fosters involvement of staff in all disci- 
plines and at all levels, programmatic goals, objectives, and ra- 
tionale evolve to become developmental and hence more 
effective. Denied this interaction, however, developmental pro- 
grams tend not to influence the goals, objectives, and rationale 
that are operationaiized in other programs within the college 
and to have little influence on overall academic achievement 
and persistence. 



Research 
evidence is 
accumulating 
to show that 
integrated 
services 
providing an 
immediate 
link between 
the need to 
know and the 
learning 
experiences 
are the most 
effective. 



The Hierarchy of Decisions Relating to 
Instructional Methods and Content 

Most college learning improvement programs, provide learning 
center services such as tutoring, multimedia materials, diagno- 
sis, and remediation. But most programs differ in the inclusive- 
ness of students likely to be served, whether a targeted high- 
risk group or all freshmen, for example, and in the comprehen- 
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sivencss of the goals, objectives, and content of the services 
provided. 

Successful developmental programs are more inclusive and 
more comprehensive in scope, usually containing several com- 
ponents: reading, grammar, writing, mathematics, science, eth- 
nic studies, study (survival) skills, self-development, and 
career/life planning (Grant and Hoeber 1978). Programs under- 
take cognitive development, using the concepts of Perry (Cross 
1976, pp. 161-67) and others, as an alternative to accepting 
low-level thinking as an immutable characteristic in lower 
achieving students. The inclusion of these various components, 
however^ does not necessarily mean the creation of additional, 
separate courses. 

In Figure 4, the range and ranking of the possible decisions 
relating to instructional methods and content are charted for the 
following developmental program variables: 

8. methods of instruction 

9. responsiveness to students 

10. development of cognitive and basic skills 

1 1 . affective development of students 

12. control for learners' success. 

Level III and Level IV decisions are achieved through the. 
systematic link of developmental support services to academic 
courses. This link expands the course instructor's resources and 
control of instruction through the creation of a highly flexible 
delivery system in which a wider range of individual needs can 
be met. The focus within each variable is on decisions that are 
made relevant to academic course instruction. The research evi- 
dence cited is from studies of programs in which this academic/ 
developmental services link has been made; some of the re- 
search reflects academic-course faculties' estimation of what 
has worked for their students. 

Variable 8. Methods of instruction 

Underprivileged and low-ability students do not always partici- 
pate in self-paced programs. Other elements are needed as well 
(Ludwig 1977). Contrary to popular belief, high-ability students 
achieve better in small discussion classes; low-ability students 
achieve better in larger classes taught in a benevolently authori- 
tarian manner (Bernstein 1976). Eclectic instruction works best, 
providing a balanced combination of individualized laboratory 
practice and class interaction (Wassman 1977). 



' Asked to indicate the relationship of special teaching meth- 
ods to students' survival, faculty indicated greater importance 
for basic skills instruction; teaching concepts; group discussion 
with tutors, with other students, and with teachers; drill and 
repetition; and personalized systems of instruction. Faculty also 
valued video and audiotapes, the inquiry method, the discovery 
method, interdisciplinary studies, team teaching, and varying 
teaching styles. No single strategy was positively related to sur- 
vival by more than 24 percent of the faculty (Simmons et al. 
1979, p. 43), which is an indication of the need for a variety of 
approaches. Engineering faculty reported success for underpre- 
pared students with review sessions (SO percent), discussion of 
homework (48 percent), selection of an understandable text (58 
percent), relating discussion' to life experiences (29 percent), 
and tutoring sessions (60 percent) (Simmons et al. 1979, p. 
32).\ 

Learning methods should include formal, informal, and inci- 
dental leaning experiences (Jason et al. 1976; Gordon 1975). 
Several characteristics of courses are related to students' suc- 
cess: clear goals for students; evaluation through frequent test- 
ing; self-paced learning; active, not passive, students; and small 
modules (Cross 1976). 

Level I decisions^ Standard methods are used within the aca- 
demic course. Students experiencing academic difficulty receive 
no assistance directly with their course work beyond that which 
benevolent instructors can provide on their own time. 

Level II decisions. Standard methods are used within the aca- 
demic course. Outside tutoring services may provide an alterna- 
tive, or at least more repetition, for some students. 

Level III decisions. Coordinated, supplementary, varied 
learning experiences are specially designed to augment the 
usual course presentation for son^e learning objectives. 

Level IV decisions. Eclectic approaches to instruction are 
used in academic courses, recognizing that no one* method will 
be sufficient for all students and that each method may work 
best for some. A balanced combination of classroom interper- 
sonal interaction and out-of-class learning assistance provides 
opportunities for students 9 participation in class, which is nec- 
essary to achieve involvement and cognitive development, and 
drill/repetition, which are needed to achieve mastery of requi- 
site basic information and skills. The course content is devel- 
oped sequentially, includes requisite cognitive and basic-skills, 
and is based upon students' diagnosed needs. \ 
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Figure 4 



The Hierarchy of Decisions 



Variables 



i 



Methods of 
Instruction 


T 

Responsiveness to 
Students 


Development of 
Cognitive and 
Basic Skills 


Within academic 
course, use 
eclectic methods 
and combination 
of class interac- 
tion and out-of- 
class drill. 


Within academic 
course, vary 
teaching lime 
and tasks accord- 
ing to response 
of students. 


Incorporate de- 
velopment of 
requisite knowl- 
edge and skills 
within ongoing 
academic curric- . 
ulum. 


Systematically 
develop other 
learning experi- 
ences for some 
objectives to aug- 
ment the course. 


Develop selected 
specific skills in 
coordinated, sup- 
plementary activ- 
ities. 


Develop selected 
specific skills in 
coordinated, sup- 
plementary activ- 
ities. 


Use standard 
methods only in 
academic 
courses; encour- 
age individuals to * 
seek help from 
others. 


In academic 
courses, provide 
same time and 
tasks for all. Let 
'other services re- 
spond to atypical 
needs. 


ASSUmC UaSlC 

skills and knowl- 
edge to be ade- 
quate for 
\ academic 
courses. 


Use standard 
methods only in 
academic 
courses; provide 
no individual as- 
sistance for aca- 
demic course 
work. 


Assume that re- 
medial courses 
will eliminate 
differences; in 
academic 
courses, provide 
same time and 
tasks for all. 


Teach generic 
skills in remedial 
courses, assume 
those who com- 
plete course to 
be ready for reg- 
ualar courses. 
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Relating to Instructional Methods and Content 
Variables 



Affective 
Ibevdopment of c 
Students 


Control for 
Learners' Success 


Structure of 
Developmental 
Program 


Incorporate per- 
sonal growth and 
counseling into 
academic pro- 
grams. 


Within courses, 

manage instruc- 
tion to provide 
frequent suc- 
cesses; use 
grades based on 
competency with 
absolute learning 
standards. 


IV 

Comprehensive 
Learning 
Systems 


Structure series 
of counseling/ad- 
vice contacts for 
all students. 


Maintain mini- . 
mum compe- 
tency by 
re teaching and 
rete sting for se- ■ 
lected objectives 
Jn academic 
courses. 


Hi 

Course-related 
Learning "' 
Services 


Refer students 
with emotional 
problems to 
counselors for 
help. 


Help individuals 
become self-di- 
rected learners 
through counsel- 
ing on their 
learning prob- 
lems. 


11 

individual 
Learning 
Assistance 


Establish compo- 
nent in applied 
psychology as a 
separate course 
or within an ori- 
entation or reme- 
dial course. 

V 


Allow students 
to sink or swim 
in the regular 
program. 


1 

Remedial 
Courses 



Raising Academic Standards 



Variable 0. Responsiveness to students 
Many educators wJk> seek to meet students' individual learning 
needs find that it is eaner said th^n done, A survey of commu- 
* nity college programs in New Jersey showed that there was 
little true individualization of students' real needs despite the 
widespread claims that these programs were individualized 
(Kahn 1977). \ 

The critical variables for learning are (1) the amount of stu- 
dents' exposure to course material, (2) the amount of time stu- 
dents spend in directed, structured learning situations, and 
(3) teachers' skills (Maxwell 1979, p. 381), When the task is 
held constant, the time needed to complete the task varies 
among students, A sizable amount of evidence supports this 
view (Grant et al. 1979; Webb 1977). \ 

Teaching methods should be researched and practiced before 
being used in an academic course. If a particular method is effec- 
tive with students, it should be retained; if not, it should be dis- 
continued with that particular group (Simmons et ah 1979; Grant 
and Hoebef 1978), Faculty sbouldpTary their teaching style and 
look for nonverbal responses to lectures (Simmons et al, 1979), 

In colleges with successful developmental programs, more 
faculty feel that the college in general tries to respond to stu- 
dents' needs and desires (68 percent in colleges with successful 
programs, 48 percent in colleges with unsuccessful programs). 
Similarly, more students in the colleges witli successful deveK 
opmental programs feel that their colleges generally respond to 
their needs as students (New York State Education Department 
1977/p. 42). 

Personalized systems for instruction have been validated for 
greater effectiveness for long-term learning than die lecture 
method. Bloom's conclusion was that 95 percent of students 
can master a subject if sufficient time is allowed. Bloom's 
basic concept is supported by the research, but not all learners 
achieve equally (Ludwig 1977). The learning time that can be 
provided is limited, howeyer, by institutional and personal rtr 
sources and by student^' motivation to persist (Cross 197S), 

Tutoring enhances Jhe responsiveness of programs and is ef- 
fective whether done by course instructors, professional staff, 
peers, or computers (Cross 1976). 

Level t decisions. The assumption is that remedial course 
reduce the differences among students and adequately respond 
to any special needs. Therefore, within academic courses, 
learning time and tasks are not varied. 



Level il decisions. Within academic courses, teaching time 
and tasks are the saro? for all. Students who do not respond are 
encouraged to seek assistance from other sources in the college, 
such as the developmental program staff or counselors. 

Level III decisions. Within academic courses, individual stu- 
dents' needs for some objectives are systematically met through 
'coordinated supplementary activities that provide additional 
time on a task. 

Level JV decisions. Academic faculty use diagnostic informa- 
tion and monitor students' response to instruction, modifying 
the procedures when necessary. Instructional time and tasks are 
varied according to individual .students \ learning needs. 

i 

Variable 10. Development of cognitive and basic skills „ 
Many remedial programs seek to improve basic skills in read- 
ing and mathematics; however, few concentrate on problem 
solving. Cognition needs to be taught (Ludwig 1977; Kagan 
1973) and abstracting and generalizing skills developed (Whim- 
bey and Lockhead 1981; Simmons et al. 1979). 

Low-ability students are oriented toward concrete matters. 
They have difficulty dealing with abstractions, are inclined to 
right answers rather than complexities, abstractions, or problem 
solving, and demonstrate lack of reasoning ability during evalu- 
ations. The work of such students may reflect the use of menti- 
oned material that cannot be appropriately used in different 
contexts, confusion when memorized words are used in incor- 
rect multiple choice test items, and interest in answers only, 
not in processes for obtaining answers (Ludwig 1977). 

The extent to which basic scholastic ability can be improved 
h unknown and subject to question (Kendrick 1969). Students 
can be taught higher level cognitive processes, at least through 
the level of application. However, some processes such as anal- 
ysis, synthesis, and evaluation may be beyond the reach of 
some learners. Nevertheless, faculty, must make an effort to im- 
prove students* cognitive functioning in college (Ludwig 1977). 

Ptagefs research has implications for higher education. Fifty 
percent of college freshmen are concrete thinkers, the propor- 
tion being higher in institutions with open admissions (Killian 
1980). Although all people develop reasoning abilities in the 
same sequence of stages, some adults never achieve fornal op- \ 
erations stages, which poses major questions for college plan- 
ners: How much teaching intervention facilitates the move into 
formal 6perations? What constitutes formal operations in the 
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various disciplines, especially history, social studies, and litera- 
ture? Are the wrong age students in college? The design of in- 
structional programs must include teaching activities for 
students in various stages (Killian 1980). 

Engineering instructors most often correlate the following 
special teaching methods with effective retention: individualized 
instruction (45 percent), instruction in basic skills (45 percent), 
personalized system of instruction (39 percent), and emphasis 
on concepts (39 percent) (Simmons et al. 1979). 

A democratized higher education institution in a pluralistic 
society must become a multipurpose institution with variable 
routes to success, with various missions for different students 
(Gordon 1975). 

Level I decisions. Generic reasoning and basic skills are de- 
veloped in special courses. 'Students who complete the course 
are assumed to have achieved "readiness*' for regular academic 
courses and thereafter to have no further need to learn basic 
skills. 

Level II decisions. Students in academic courses are assumed 
to have achieved mature cognition and mastery of basic skills; 
*■■*-- — therefore, teaching is conducted in the traditional manner. Stu- 
dents may obtain assistance for whatever they may -need on 
their own. 

Level III decisions. Certain cognitive and basic skills are de- b 
veloped through coordinated adjunct learning activities. 

Level IV decisions. Relevant, requisite basic and cognitive 
skills are incorporated into the structure of academic courses 
and programs. (See Killian 1980 and Ludwig 1977 for descrip- 
tions of science courses and a history course, respectively, that 
develop cognition skills.) 

Variable /i. Affective development of students 
Although researchers increasingly recognize the importance of . 
students' emotiorial needs in determining their success in col- 
lege, components and goals for affective development rc sel- 
dom incorporated into either academic or developmental 
programs. The primary emphasis on purely cognitive outcomes 
has resulted iii the neglect of such important "informal learn- 
ings*' as self-cprjcept, loCus of control, attitude toward educa- 
tion, and motivation (Runner 1979; Duck 1978; Sherman and 
Tinto 1975). V / 

Motivation and drivjfe, which are impossible to statistically 
manipulate or cojntrol (McFadden 1979), are nevertheless con- 



sidered by faculty and researchers to be the most important 
characteristic of students for determining success in college. 
Motivation and persistence are more important than traditional 
predictors (such as test scores) of success in college (Renner 
1979; Simmons et al. 1979; Donnovaji 1977; Lesnick 1972; 
Meisteret al. 1962; Bntwisle 1960; Rdueche and Kirk 1973). 

Poor academic self-image is a cause of failure in college 
(Grant and Hoeber 1978; Cross 1976). The underprepared stu- 
dent has been victimized by the school and certified an aca- 
demic failure and is justifiably wary, feeling incompetent and 
impotent in the educational world (Grant and Hoeber 1978, 
Glasser 1969). Such students must be helped to overcome fear 
m a competitive environment (Simmons et al. 1979), a sense of 
worthlessness. alienation, and hostility (Renner 1979; Jelfo 
1974). 

Students' genuine involvement in special programs is a nec- 
essary precondition for academic success. Three stages of stu- 
dents' involvement — attraction, participation, and sustained 
involvement — can be used as a barometer to measure the com- 
prehensiveness of developmental programs (Donnovan 1977)* 

Research results, though tentative, correlate students' locus 
of control with success in college. Counseling students to be- 
come responsible for themselves — to internalize their locus of 
control — rather than to place responsibility and dependence on 
schools, parents, and peers is an element in successful pro- 
grams (Grant and Hoeber 1978). Problem-solving techniques 
are beneficial for internalizing this locus of control (Ozer 1980; 
Barshis 1979; Ludwig 1977). 

Students* success in college can be predicted from a check- 
list of behaviors that differentiate successful and unsuccessful 
students. Success is predicted from such behaviors and attitudes 
as motivation (committed, ambitious, industrious, responsible), 
completion of assignments and projects on time, and an orien- 
tation toward goals (realistic, flexible, purposeful behavior). 
I Failure in college can be predicted from the persistence of the 
opposite behaviors and attitudes: a lack of motivation (apa- 
thetic, depressed, uncommitted, uninterested); incomplete or 
/iate assignments and projects (exhibiting plagiarism, lack of at- 
tention to detail, repeated errors, an inability to generalize con- 
cepts); and a lack of orientation toward goals (erratic, 
irresponsible, nonpurposeful behavior) (New York State Educa- 
tion Department 1977. Appendix C). 
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Counseling assists "personhood development" (Jelfo 1974) 
and helps the student make realistic choices, establish career 
goalsiwhich are relate d to p ere is te n ccin~cottege) rass ci t inner — 
control, and become more purposeful in daily behaviors in the 
academic life. Both peer and professional counseling are effec- 
tive (Cross 1976). 

Level I decisions. A component in applied personal psychol- 
ogy to enhance students' affective development is incorporated 
within a basic skills course or an orientation ourse or is estab- 
lished as a separate course. 

Level II decisions. Students with emotional problems are re- 
ferred to counselors for help. 

Level III decisions. A series of counseling/advising contacts 
is established to systematically achieve certain specific affective 
objectives for all students in the academic program. 

Level IV decisions. Affective goals are incorporated in the 
design of instructional programs. Facilitative experiences are 
provided for the development of self-concept and problem- 
solving abilities to foster internal locus of control (Brawer 
1982). Counseling and advising to enhance positive behaviors, 
to help students develop career goals, and to improve overall 
motivation are ongoing activities within academic programs. 

Variable 12. Control for learners 9 success 
Teachers and managers must provide opportunities for success 
and rewards for students while simultaneously providing chal- 
lenging experiences (Simmons et aL 1979). The mastery of 
skills enhances students' self-concept, se se of personal worth, 
internal control, and the creation of positive expectations (Grant 
and Hoeber 1978). Successful encounter:, with learning raise 
expectations; repeated failures lower th -m. Successful learning 
experiences strengthen self-motivated persistence and overcome 
passivity (Arkwardy and Chafln 1980; Cross 1976; Bruner 
1973). 

Management and control for success are achieved through 
the use of diagnostic instruction, grades based on competence, 
responsibility for learning, and organization of the course 
content. 

Assessing requisite skills for freshmen courses and entering 
students' abilities provides a "contrast profile" of particular 
skills to be developed for each student (Roueche and Snow 
1977, p. 83). This assessment is used to guide planning and 
instruction for academic programs and for remedial programs. 



Effective education is the product of a match between learners' 
characteristics, the learning environment, and learning tasks 
— (Cosdomi935^ _ 

Grading should be based on competency, with an absolute 
grading standard to reflect mastery (Grant and Hoeber 1978; 
Donnovan 1977; Cross 1976). Reteaching and repeating tests 
up to three times improve learning; the fourth time does not 
(Donnovan 1977). 

Under such conditions, achievement in a course depends less 
on students' entering skills or abilities. Correlation between ap- 
titude and achievement is typically lower under mastery learn- 
ing than under other instructional programs. The slowest 
students have the time they need, and the systematic structure 
allows for necessary remedial assistance in a regular, prescribed 
manner. Learning outcomes rather than teacher behaviors are 
emphasized (Ludwig 1977). 

In the past, compensatory education has tended to shift the 
responsibility for learning more to the teacher than to the stu- 
dent (Gordon 1975). Students must, can, and should, however, 
assume more responsibility for their own learning (Cross 1979). 
The design of instructional material featuring mastery learning 
and individualized methods causes students to assume responsi- 
bility for achieving goaisj£a~ flexible schedule; teachers and 
students plan together to overcome a particular difficulty and 
retest when necessary (Renner 1979). 

Within the course, clear statements of objectives enable stu- 
dents to know the outcomes required; courses should also pro- 
vide different formats and alternate routes for reaching those 
objectives (Cross 1979). Communicating positive expectations 
for success and sequencing instruction from the more easily un- 
derstood concepts to the more complex ones are associated with 
successful programs (Simmons et al. 1979 Roueche and Snow 
1977). 

Level I decisions. Students are allowed to sink or swim as 
best they can in the regular academic program. Remedial 
courses attempt to teach students how to learn. 

Level II decisions. The rescue of some students is attempted 
through tutoring services. Students are helped to become more 
self-directed, effective learners through the use of problem- 
solving techniques applied to the course in which they are ex- 
periencing difficulty (Maxwell 1975). 
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Level III decisions. Minimum competency on some course 
objectives is maintained through the use of adjunct learning ex- 
periences and retesting. 

Level IV decisions. Instruction within the academic course is 
managed so as to provide frequent successful learning encoun- 
ters for all students. Grades based on competency to an abso- 
lute standard and re testing when necessary are used instead of 
relative or curved grading standards. Clearly communicated ob- 
jectives and alternative routes for learning ensure an opportu- 
nity for success for most students. 

Learning improvement and program structure 
The most effective instructional system for learning would not 
be thought of as a learning improvement program, because 
most of the services provided by the developmental personnel 
would be fully incorporated into academic courses. It is very 
difficult, however, to change, through formal administrative 
procedures, the way academic instruction is organized and 
delivered. 

For this reason, the structure of the developmental program 
within the college determines, more than any other single vari- 
able, the ability of the program to influence academic instruc- 
tion and thereby genuinely improve learning. If resources for 
the developmental program are expended in a structure of activ- 
ities that directly supports academic courses, then course in- 
structors* capabilities are greatly expanded and eclectic, 
diagnostic instructional methods in academic courses are possi- 
ble. Atypical and extreme needs can be responded to, and rele- 
vant cognitive and basic skills and affective development can 
be provided. Furthermore, academic faculty and curriculum 
leaders perceive as helpful the evolving reorganizations of in- 
struction that they themselves have helped design. 

This process works both ways. Integrated services lead to a 
changing organizational structure for the developmental pro- 
gram as well, changes that are well received by the faculty 
whose classroom problems are being ameliorated but may be 
hardly noticed by anyone else. 

The Hierarchy of Decisions Relating to 
Institutional Policies and Standards 

Ultimately, to become permanent, these changes in structure 
must be established in the policies of departments, divisions. 



and the college or university. One manifestation of administra- 
tive support for an improvement in learning is the academic 
policies and standards that are established and enforced within 
the institution (Ark warty and Chafin 1980). Standards imply 
achievement of genuine learning, which is more than "merely 
succeeding" (McCabe 1981). Figure 5 indicates the range of 
possible decisions for each of the following variables relating to 
institutional policies and standards: 

13. directing students into appropriate courses and programs 

14. definition of competencies in academic courses 
45. credit earned for remedial developmental study 

16. systematic procedures for advisement 

17. organization of the developmental program within the 
college 

18. institutionalization of developmental services. 

Variable 13. Directing stude nts into appropriate 
courses and programs 

It is rare to find a college that has not modified its admissions 
standards in the last 10 years (Grant and Hoeber 1978). Col- 
leges are coping with; kinds of students not previously educated 
to this level. Current controversies are similar to the debate 
about secondary schools in the 1890s and 1900s, the central is- 
sue today being the adequacy of the higher education system to 
absorb and adapt to its new clientele (Grant et al. 1979. p. 8). 
The average high school graduate. today has a "B" average 
over four years of high school yet reads at the eighth grade 
level, a loss of two grade levels in the last 10 years (Roueche 
1981-82, p. 17). 

Controversy has raged over whether underprepared students 
should be required to participate in remedial courses. Some 
studies show a decline during the 1970s in the number of insti- 
tutions mandating remedial courses, perhaps indicating the 
trend of the future (Grant and Hoeber 1978). Of institutions 
surveyed in 1977, 89 percent did not require the courses (p. 
28), The New York State Education Department study (1977) 
also favors voluntary enrollment in remedial courses, which 
students would accept when counseled properly. 

Three studies over a four-year period involving large num- 
bers of students at the Bronx Community College show a dif- 
ferent outcome, however. Although many students did enroll, 
high percentages of students, ranging from 14 to 65 percent, 
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Figure 5 The Hierarchy of Decisions: \ 
Variables 
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Relating to Institutional Policies and Standards 
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chose to bypass the courses (Bronx Community College 1974, 
1975; Eagle 1977). 

The impact of large numbers of underprepared students on 
the practices and standards within tegular courses has rarely 
been considered in research studies. It has been assumed that 
traditional academic standards would prevail and that instruc- 
tors would fail inept students who chose to bypass courses 
teaching basic skills and enter regular programs. What has oc- 
curred instead is a drift of standards so great that it has threat- 
ened the credibility 6f all ofJiigher education and particularly 
of community college general education programs, where free 
access despite academic deficiencies has been prowled, even to 
"semiliterate" and "illiterate!' students (Cohen 1979). Stu- 
dents from community colleges have a higher attrition rate than 
other students after they transfer to four-year institutions 
(Roueche 1981-82). Cohen (1979) associates the increased in- 
terest in junior year examinations to four-yeqr colleges' efforts 
to deal with the extremes of ability among junior-year transfer 

students. \ 

Mandatory placement in skills courses is associated with suc- 
cessful programs (Roueche and Snow 1977). Current opijiion 
links participation in developmental services with the mainte- 
nance of standaixis in the overall academic program (Roueche- > 
1981-82; Arkwardy and Chafin 1980), a connection that here- 
tofore has been largely ignored. 

Robert H. McCabe, President of Miami-Dade Community 
College, initiated major changes in polky to upgrade the stan- 
dards of achievement of students at his institution, among them 
the controlled ftow-of deficient students through remedial pro- 
grams and restricted schedules until students demonstrate their 
ability to perform successfully. Given these controls, faculty 
will be able to provide instruction to students "within a nar- 
rower range of academic competence," thus increasing the 
likelihood of success (McCabe 1981, p. 10). Only if a student 
body is properly prepared in basic skills can standards be main- 
tained in other courses (Trillin and Associates 1980, p. 262). 

Restricting high-risk students' v it-semester credit hours and 
guiding their selection of courses r hose in which they have a 
chance of cceedin* have been veiled as ways to enhance 
long-term * :cess .his 1979). If students' skills are ade- 
quate, thefc > ;rticip<uu>!> \i) a support program alone might be 
justified. If V v are hi.. )uate, remediation is a must (Sim 
mons et al. IS ')) i > students must not be permitted %: 



enroll for a full academic course load (Roueche 1981-82). Stu- 
dents with deficiencies who begin programs should be expected 
to take longer to finish them (Roueche 1981-82; McCabe 
1981). 

Placement testing of all students who enter the college is 
necessary to enable the college to provide proper direction to 
its students. Colleges should develop their own local norms and 
determine their own success thresholds for whatever tests are 
used (Roueche 1981-82; New York State Education Depart- 
ment 1977; Cross 1976). 

Level I decisions. Participation in remediation is voluntary. 
Learning specialists' recommendations are not communicated to 
advisors and not used in students' academic planning. 

Level II decisions. Students may elect or reject individual di- 
agnosis, advisement, and remediation. Learning specialists" rec- 
ommendations about which courses to select may or may tax 
be used in students' academic planning. 

Level III decisions. Within an academic course, pretesting 
for some objectives provides a basis for some required supple- 
mentary assignments. 

Level IV decisions. For all incoming students, placement 
testing provides the basis fpr directing students into appropriate 
courses, supplementary study, and schedules. Credit hours for 
high-risk and working students are restricted until students** 
demonstrate their ability to do more. 



Variable 14. Definition of competencies in academic courses 
No absolute standards of competency exist for college courses 
and degrees. Standards for entry and exit must be defined for 
courses and programs (Cohen 1979; Jelfo 1974). It is patroniz- 
ing to students to modify standards; to do so implies that they 
. are incapable (Gordon 1975). "Colleges must make a commit- 
ment to standards ..." (McCabe 1981, p. 10). 

Considerable national interest exists for defining the compe- 
tencies to be obtained from a college education. Government 
officials and state accreditation agencies increasingly seek ac- 
countability as a condition of funding (Chronicle 16 December 
1981; Magarrell 1980; Fincher 1975). Colleges must establish 
and enforce high performance standards for credit and degrees 
(Arkwardy and Chafin 1980); otherwise, society will reject the 
institutions. There must be a point at which it is determined 
that a student is not going to succeed in the institution and that 
further investment is not justified (McCabe 1981). 
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The College Outcome Measures Project (COMP) is a cooper- 
ative effort of approximately 130 participating colleges and the 
American College Testing program (ACT) to define and mea- 
sure the competencies obtained from general education in col- 
lege. Several "generations" of tests have been used and a data 
base accumulated, through which institutions can assess the rel- 
ative effectiveness of their programs (ACT Program 1980). 

Level I decisions. In academic courses, standards are ad- 
justed by curving grades and/or changing requirements. The ac- 
ceptable level of competency is allowed to fluctuate with the 
norm of each group of students taking the course. 

Level 11 decisions. The availability of tutorial assistance to 
individuals is assumed to ensure adequate learning by weaker 
students. 

Level III decisions. In academic courses, minimum compe- 
tency for some objectives is specified and required of all stu- 
dents. 

Level IV decisions. In academic courses, minimum acceptable 
competencies for most objectives are specified. Prerequisite 
entry-level skills are published to guide the placement of students 
and any concurrent (or preenrollment) remediation indicated. 

Variable 15. Credit earned for remedial/developmental stud? 
Should credit for graduation be earned in remedial/developmental 
courses and supplementary study? This issbe has been' a divi- 
sive one, although the trend is to award credit. In a 1977 sur- 
vey, 65 percent of responding institutions indicated that they 
grant credit f ^uch courses (Grant and Hoeber 1978). Institu- 
tions should . - credit (Cross 1976; Jelfo 1974). especially if 
courses are required (Grant and Hoeber 1978). The granting of 
credit is associated with successful learning improvement pro- 
grams (Roueche and Snow 1977) and is necessary to motivate 
students to take the courses seriously; ! 

Low-potential decisions. Credit is not awarded foi remedial/ 
developmental study. <*""' 

High-potential decisions. Remedial/developmental study 
earns credit, either as an individual course or as part of the 
assigned work for grades within an academic course. 

Variable 16. Systematic procedures for\ advisement 
Traditional advisement and counseling services are inadequate 
to help students understand their options, registration policies, 
program requirements, and other comjwnents of the educational 



system. In addition, a strategy of academic intervention is 
needed, which will incorporate student orientation and provide 
systematic monitoring of students'* progress and regular follow- 
up (Boylan 1980). 

Implementing policies that allow performance, not timi in 
the program, to determine a student's rate of progress and en- 
forcing performance standards will increase the time needed by 
many students to complete their programs. Typical descriptions 
of program sequences and time frames are inappropriate and 
should be eliminated (Roucche 1981-82). Students will pursue 
unique combinations of courses and complete requirements at 
individual, atypical times. 

Advising students, traditionally routine and perfunctory, must 
become personalized. Diagnostic information about students* 
abilities and complex information about course and program re- 
quirements must be interpreted for students and used to help 
them choose appropriate courses in which they can realistically 
be expected to succeed. Information about students* progress 
must be given to advisors, and a system of monitoring progress 
toward the completion of program goals must be established. 

Low-potential decisions. Students are routinely advised 
through typical course sequences by faculty advisors who lack 
* diagnostic information about students* individual instructional 
needs. 

High-potential decisions. Systematic procedures for monitor- 
ing students* progress, initiating intervention, and enforcing 
policy and standards are implemented/ An information system 
to support the use of diagnostic information hi the selection of 
courses and the planning of the program is established. 

Variable 17. Organization of the developmental 
program within the college 

Two categories of problems are associated with the administra- 
tion of learning improvement programs: (1) those that concern 
the integration of the services into the existing structures of the 
college and (2) those that concern the leadership and adminis- 
tration of the program itself (Kingston 1955>. The literature re- 
viewed for this monograph supports the irv igration of 
developmental instruction into the academic programs of the 
college and recommends many ways to better integrate ser- 
vices. 

"Establishing remedial courses in already existing departments 
is easier in terms of administration, but the evidence suggests 
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that establishing a separate department or division of develop- 
mental studies is more effective (Grant and Hoeber 1978; Jelfo 
1974). A division or department is characterized by its own ad- 
ministrative ieaddr, who plans coordinates, and allocates 
funds. This structure has several advantages: the ability of the 
division to conduct systematic ,< collegewide assessments of 
needs,, to develop and promote the program, and to be a highly 
visible center for innovation and change (Roueche and Snow 
1977). The most successful programs have their own space, 
which is centrally located on cangpys^onnovan 1977). They 
have their own staff and have easy acces\Students perceive 
locations that are difficult to reach as demeaning (New York 
Stau ^xiucation Department 1977). < 

Developmental programs organized around a department or 
division accounted for 67 percent of the successful college pro- 
grams in one study. Programs consisting of fragmented courses 
scattered throughout other divisions tended to be less success- 
ful, as did programs comprised of regular faculty attached to 
their own departments who worked with counselors (Roueche 
and Snov\$977, pp. 89- 0). 

Successfully integrated programs use a variety ofmnique and 
flexible arrangements in which developmental faculty working 
with regular faculty coordinate objective^ for basic and regular 
instruction (see Roueche and Snow 1977, sec, 3). Courses in 
basic skills are most successful when they are perceived as 
regular courses within an academic department's academic 
program —courses that some students are placed in as a result 
of testing and that others exempt. No commitments to award 
credit for exemption are necessary or implied by exemption. 

The staff of developmental programs should have a "larger" 
role in the college's academic decision making M avoid feel- 
ings of alienation and to bring their insight and influence to 
be& in planning. Developmental faculty should be appointed to 
administrative positions and to*faculty committees, which 
would have the additional benefits of improving students' and 
faculty's perception of them as "real" teachers (Simmons et al. 
1979). It would improve the perception of the program as hav- 
ing a central, vital role, not an ancillary one (New York State 
Education Department 1977). 

Level I decisions. Courses in basic skills are scattered among 
existing divisions with little or no coordination. _ 

Level II decisions. The leadership of the developmental pro- 
gram is subordinated within another division or precollege unit. 
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Level III decisions. A developmental division coordinates 
support services and presents its own courses. 
, Level IV decisions. A developmental division administers the 
program through a leader who plans, coordinates, and allocates 
funds for a comprehensive program. Developmental faculty 
participate in college and academk decision making. Develop- 
mental courses and components are subsumed into the regular 
course sequences within the academic divisions but are staffed 
and coordinated by the developmental division. 

Variable 18. Institutionalization of developmental services 
Decisions about policies and standards reflect the extent to 
which a college has institutionalized the developmental concept 

' developmental services into its academic mainstream. The 

.1 levels of decisions within the Hierarchies represent these 
varying. degrees of institutional commitment. They comprise as 
wqII the sequence of stages through which developmental lead- 
ers gain influence and help to shape decisions about policies 
and standards within the college. 

Level I decisions. Interdisciplinary links, contacts, and op- 
portunities for service are sought to enlarge the influence of the 
developmental program beyond the constraints of isolated 
courses in* basic skills. 

Level 11 decisions. The developmental concept is established 
in individual, voluntary service to students and teachers. 

Level III decisions. The developmental concept is written 
into policy, requirements, and procedures of congenial depart- 
ments and courses. Consensus for the concept of a develop- 
mental program is evolving; however, an agenda for the 
developmental program for the curriculum or institution is not 
yet recognized. 

Level IV decisions, the chair of the developmental program 
and the developmental faculty serve on college committees and 
strive to integrate the developmental concept into policy state- 
ments, design of curricula, and problem-solving processes. 
Statements describing requirements for proficiency and proce- 
dures for reinforcement and remediation are specified for ap- 
propriate courses, levels, and transitions in the college. These 
statements are published in catalogs and syllabi. 
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The relationship between the enforcement of policies and 
standards and the structure of teaming services 
The enforcement of policies that guide students into and 
through appropriate academic programs and maintain prescribed 
performance standards can be expected to improve students* 
achievement. However, merely declaring policy statements that 
are not carri&J out is of littk value. The structure of the learn- 
ing services within tfte institution determines the extent to 
which such oolicies ?iz enforceable, given the practical con- 
straints of the con5CWi v x)raP/ higher education environment. 

Level IV, comprehensive, multiservice programs provide the 
flexibility of| courses m ;;.s?ic skiHs &vi alternative instructional 
arrangement^ through which resources can bp efficiently ap- 
plied for student-: spr^fic nee • . Such flexibility is important 
for gaining students' -rceptancc j f<;rt'orrnance standards and 
for providing for in4'"- v f iai problems thai otherwise would re- 
suit in waivers of n jpwments. / 

For example, a t. . ; rnr problem in four-} car colleges is the 
transfer student who needs re.wdiation cm a basic skill despite 
having transf^rrcii with acceptable credit, for rebtcu general ed 
ucation counts. Consortium agreements; with other colleges or 
other practical considerations may preclude the requirement of 
an in-house version of a course for which another allege has 
awarded credit. However, the remediation ran be accomplished 
through mandated competency requirements and individual 
learning assistance or course -related instructional requirements. 
Given the fa^t that one-third of all college students are transfer 
srudents (Cohen 1979). feasible. cnfor:eable ways to ensure 
that transfer 'students have basic skills are significant considera- 
tions in the design of developmental programs. . . 



The Hierarchy of Decisions Relating to - v * ' 

Professional and Paraprofessional Stan and Roles 

The changing environment for teaching and the increasing di- 
versify of students place demands on teachers for new kinds of 
skills. Figure 6 shows the ranking of the possible decisions re- 
lating tc professional and paraprofessional staff and roles for 
the following variables: \ 

19. regular course instructor's role \ 

20. developmental program staff and role 

21 . counseling staff and role 

22. faculty and staff development. 
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The variables are ranked according to whether they have high 
or low potential for improving students' learning and effecting 
instructional develppment. 

Variable 19. Regular course instructor's role 
The academic instructor is the content specialist and the man- 
ager of the instructional f/ ;>eess (Arkwardy and Chafin 1980). 
In the Loop College Individual Needs Program, a program 
identified as highly successful for developing students' achieve- 
ment (Roueche 1981-82), the course instructor is a "focusing 
agent" for the student and is learner-centered and caring (Bar- 
shis 1979). 

Teaching faculty can manipulate six closely related aspects 
of the learning environment to, fit students' learning styles and 
needs: (I) content — the subject matter, sequence, and pace; 
(2) classroom format and structure— the mix among alternative 
teaching strategies; (3) noninstructor-centered, out-of-class 
activities — homework, fieldwork, supplementary activities; 
(4) instructor-centered, out-of-class activities and meetings with 
individuals and groups; (5) evaluation modes; (6) personal style 
and classroom climate — style of interaction between instructor 
and student and among students (warmth versus coolness, per- 
sonal visibility and role modeling versus low-key profile) (Bess 
1979, p. 260). 

In one study, engineering faculty stated that as teachers they 
need to understand that the purpose of a teacher is to serve as a 
mediator between content and student, that they may sometimes 
need to move outside then* classrooms into other experimental 
learning situations such as seminars and informal occasions, 
that students are "overwhelmingly" dissatisfied with teaching 
and the quality of instruction, and that interdisciplinary ap- 
proaches are superior for .jme purposes (Simmons et al. 
1979). 

Low-potential decisions. Academic course instructors func- 
tion primarily as "passive purveyors of information" (Ark- 
wardy am Win 1980, p. 113). 

High-potential decisions. Academic course instructors focus 
on learners' needs and responses, manipulate the learning envi- 
ronment to improve learners' achievement of course objectives, 
and use developmental program resources to extend the range 
of options and support available to their students. 
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Figure 6 The Hierarchy of Decisions: Relating to 

Variables 
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Course Instructor's 
Role 



Manage learner- 
centered instructional 
process. Interact with 
developmental pro- 
gram staff to extend 
range of options for 
learning. 



Teach course con- 
tent, . formation in 
tradit'raal, inflexible 
ways. Provide few 
alternative learning 
activities. 



Developmental Staff 
and Role 



Use a multilevel 
staff. Make a spe-^ 
cialist available to 
consult and collabo- 
rate with academic 
faculty. 



f 



Use professional 
staff only. Restrict 
specialists primarily 
to remedial teach- 
ing. 
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Professional and Paraprofessional Staff and Roles 

Variables 



Counseling Staff and 
Role 


Faculty and Staff 
Development 


^tnirtiir** nf 

Developmental 
Program 


Coordinate 
counselor-student 
contact within aca- 
demic programs. 
For academic fac- 
ulty, develop skills 
as advisors and 
counselors. 


Use informal and 
formal settings for 
instructional prob- 
lem solving as a 
staff development 
activity. Regular 
faculty and develop- 
mental specialists 
collaborate to de- 
velop needed tech- 
niques 


IV 

Comprehensive 
Learning Systems 

III 

Course-related 
Learning Services 


Isolate counseling 
and advising within 
separate facilities. 


Ignore staff devel- 
opment needs. 


ii 

Individual Learning 
Assistance 

I 

Remedial Courses 



\ 



Raising Academic Standards 

i 



63 

73 



Variable 20. Developmental pn&wf* staff and role 

The developmental program uses u multilevel staff, including 

professionals, paraprofessionals* and volunteers. 

The influence of the learning specialist is increasing. For- 
merly ignored in academic decisions about students, learning 
specialists are increasingly asked for assistance by academic 
faculty attempting to meet the needs of underprepared students 
(Maxwell 1979, p. 386; Pinette and Smith 1979; Walter 1979). 
They are increasingly asked to provide specific serv ices such as 
conducting workshops for faculty and students and developing 
modules on vocabulary, comprehension, and other topics 
(Adams 1974). 

Successful programs use well-trained peer helpers and other 
paraprofessionals such as graduate assistants and teaching assis- 
tants (Awkwardy and Chafm 1980; Simmons et al. 1979; Max- 
well 1979; Wassman 1977; New York State Education 
Department 1977; Roueche and Snow 1977; Gordon 1975; 
Jelfo 1974). The use of such affordable helpers as tutors, coun- 
selors, and clerical aides enlarges the developmental program's 
capability to enhance resources for academic courses as well as 
its own courses. Peer helpers are particularly successful with 
students. 

Low-potential decisions. Restrict the learning specialist's role 
to teaching remedial courses and use professional staff only. 

High-potential decisions. Use a multilevel staff. Make a 
learning specialist available to consult and collaborate with aca- 
denre faculty. 

Variable 21. Counseling staff and role 
Counselors must get out of their offices (Roueche and Snow 
1977, p. 122). Faculty must develop special sensitivity to their 
students. Faculty, in both formal and informal advising situa- 
tions, must have the skills to communicate positively instruc- 
tional needs and options. They must respond appropriately to 
resilient learners, who have the energy to learn; to reluctant 
learners, who are affected by past histories of failure; and to 
naive learners, who mistakenly believe as a result of being re- 
warded for ncnachievement that they have certain skills (Ark- 
wardy and Cfcafin 1980). Cognitive gains may be much less 
important in the long run than the changes in attitude, which 
are infinitely harder to bring about (Grant and Hoeber 1978). 

Low-potential decisions. Counseling contacts are available to 
students only within a separate facility. 



High-potential decisions. Academic faculty develop sensitiv- 
ity mid skills as advisors/counselors to students and incorporate 
counseling in their programs for their students' affective devel- 
opment. 



Variable 22. Faculty and staff development 
The average faculty member must learn new methods to deal 
with the range of abilities confronted in the classroom (Cross 
1979). Sixty-three percent of engineering faculty considered 
themselves inadequate to teach underprepared students and 
mentioned their needs for training in evaluation, diagnosis, tra- 
ditional and new methods of teaching, development of curricu- 
lum, and organizational development, including team building, 
decision making, and problem solving (Simmons et al. 1979, 
P 17). ^ 

' Faculty and staff must be energetically involved in both plan- 
ning and implementing for staff development to have lasting ef- 
fect (Simmons et al. 1979; New York State Education 
Department 1977). In a time of steady and declining enroll- 
ments with concomitant diminishing resources, it is important 
to reorient the educatiohal system to create seltairected learn- 
ers (Cross 1979). 

Low-potential decisions. Staff development is not undertaken 
in formal or informal contacts. 

High-potential decisions. Developmental and academic fac- 
ulty collaborate for staff development that focuses on instruc- 
tional problem solving and development. 

The relationship between professional roles and 
the structure of the learning improvement program 
Ongoing, mutual staff development occurs as a natural conse- 
quence of the collaboration of developmental and academic fac- 
ulty to develop learning activities for students. Resistance to 
change is diminished when faculty seek assistance to solve stu- 
dent*' framing problems in their programs. The structure of a 
developmental program is thus the most important variable for 
achieving effective staff development. Developmental program 
models that foster interdisciplinary contact facilitate staff devel- 
opment. Program models that isolate learning specialists inhibit 
the ongoing, problem-solving contacts through which academic 
faculty might be influenced to use new methods and acquire 
new skills. 
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The Hierarchy of Decisions Relating to the 
Evaluation of Learning Improvement Programs 

What should be measured, and how, in the evaluation of learn- 
ing improvement programs when the values being sought are 
improved GPA and retention? Evaluation is the " . . . process 
of delineating, obtaining, and providing useful information for 
judging decision alternatives ..." (Stufflebeam 1971, p. 37). 
Because students' learning outcomes and the impact of the 
remedial/developmental program are enhanced or constrained 
by the decisions of many people within the college, the scope 
of the evaluation must be such that all decision makers have 
accurate information about the effects of all the controllable 
variables that are relevant to a particular instructional setting — 
including "students' behavior, developmental and regular pro- 
gram practices, and institutional policies. 

The Hierarchies in the aggregate contain a comprehensive list 
of variables that research has demonstrated to be significant in 
the design of learning improvement^programs. Determining the 
institutional status of each of these variables provides a frame- 
work for evaluation and the subsequent improvement of 
remedial/developmental and academic programs. 

Figure 7 ranks the possible decisions relating to the evalua- 
tion of learning improvement programs for four critical vari- 
ables: 

23. institutional context and outcomes 

24. student outcomes 

25. academic standards and the grade point average 

26. ongoing evaluation. 

Variable 23, Institutional context and outcomes 
The more successful remedial/developmental programs are 
characterized by a high degree of integration of developmental 
services, philosophy, and staff within the academic life of the 
institution. So it is with evaluation itself. All aspects of policy, 
regular programs, and institutional context that affect the devel- 
opmental program, influence the learning of students, and/or 
establish the standards by which students are judged must be 
considered if the study is to account for a significant proportion 
of the factors affecting students' learning (Roueche and Snow 
1977, p. 104; Gordon 1975). * 

Success in effective programs is measured against the institu- 
tion's long-term goals and its short-term performance objectives 
(New York State Education Department 1977, p. 74) and exter- 



nal standards of accountability when they are applicable (Mc- 
Fadden 1979). The criteria of success may be better 
performance in the next level class as well as better test scores 
(Maxwell 1970, 1979; Cross 1976). Local definition of suc- 
cess are legitimate. For example, in light of extraordinary cir- 
cumstances of background, a modest rate of persistence of 40 
percent might show success (Donnovan 1977). 

In strong programs, institutional outcomes are assessed in ad- 
dition to student outcomes; those institutional outcomes might 
include the most efficacious allocation of resources, revisions 
of admissions criteria and program standards, greater program 
visibility and acceptance, staff development, increased coopera- 
tion and communication among faculty, and a broader base of 
support (New York State Education Department 1977). Al- 
though it is important to understand the impact of programs for 
the disadvantaged on their institutions, almost nothing is known 
about the subject (Richardson et al. 1981; Donnovan 1977). 
Evidence of institutional response and change toward more use 
of developmental concepts is sought. 

Several levels within the college are involved in the evalua- 
tion, including the developmental program staff, the academic 
program stafc and participating program administrators (Sim- 
mons etal. 1979; New York State Education Department 
1977). Evaluators should ask several questions: What is the re- 
lation of the developmental program evaluation to the regular 
academic program evaluation? Are the appropriate academic 
faculty, involved in diagnosis and setting standards for the 
learning services and skills courses? Does scheduling allow 
interaction and cooperation with other faculty? Do opportunities 
exist for staffing dual assignments? (New York State Education 
Department 1977). 

Level I decisions. Although overall learning, represented by 
data on GPA and persistence, may be used as a criterion of 
success, the outcomes arc explained only in terms of the reme- 
diaTprogram. The influence of the college's policies and aca- 
demic program practices is not examined. 

Level II decisions. Some institutional factors are considered 
in evaluating the assistance given to individual students; how- 
ever, the college's practices are not systematically described, 
evaluated, or recommended for their effect on learning. 

Level til decisions. Instruction and other relevant factors 
within an associated academic course or program are included 
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Figure 7 The Hierarchy nt Decis 5 
Variables 
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Insfirmionaf 
Context and 
Outcomes 


Student Outcon^ 


Analyze all relevant 
regular faculty prac- 
tices, institutional 
factors, circumstan- 
ces, and outcomes; 
make institutional 
rccom me ndations . 


Assess changes 
based 02 criterion 
tasks reia;td to the 
content of services 
and course, on 
grades, and on indi- 
ces in academic 
courses. 


Analyze selected rel- 
evant features within 
an adjunct academic 
course. 


Within an academic 
course, assess 
change using crite- 
rion tasks for a few 
integrated develop- 
mental activities as 
in Levei IV. 


Mention some insti- 
tutional factors per- 
taining to assisted 
students. Do not sys- 
tematically analyze 
institutional factors. 


Assess changes us- 
ing general tests 
and academic 
course grades. 


Exclude institutional 
factors, effects, aca- 
demic faculty. Study 
students and remedial 
program only. 


Assess outcomes 
with no analysis of 
change. 
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± 

the Evaluation of Learnicf Improvement Programs 

Variables 



Academic 
Standards and 
GPA 


Ongoing 
Evaluation 


Structure of 
Developmental 
Program 


Analyze competen- 
cies represented by 
GPA. Assess rela- 
tionship between 
developmental and 
regular programs. 


Assess and provide 
periodic feedback. 
Use follow-up stud- 
ies. Analyze long- _ 
term effects, 
changes. 


IV 

! Comprehensive 
: Learning Systems 

i 


Within adjunct or 
follow-on course, 
assess relationship 
between regular and 
remedial instruction 
and competencies 
represented by 
grade criteria. 


Monitor changes 
through a course 
and a follow-on 
course. 


III 

Course-related 
Learning Services 


Use grades in ver- 
bal or quantitative 
courses as a crite- 
rion of the effec- 
tiveness of 
assistance to indi- 
viduals. 


Limit evaluation to 

a single semester. 

•> 


II 

Individual Learning 
Assistance 


Use GPA as a crite- 
rion for discrete 
skills courses. As- 
sume relevance of 
skills and course 
'work to the content 
represented by 
GPA. 


Underlie no sys- 
tematic evaluation 
of the developmen- 
tal program on 
overaii, long-term 
learning. 


I 

Remedial Courses 
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in the evaluation of developmental services. The regular course 
instructor participates in the evaluation. 

Level IV decisions. Regular faculty as well as developmental 
faculty are involved in planning and implementing the evaluation. 
The evaluation of the teaming improvement program is perceived 
in relation to the college's mission to its overall instructional 
program. Using a variety of indices, it assesses regular program 
and institutional status, needs, and change, it produces recom- 
mendations for institutional policy and charges in the regular pro- 
gram as we J! as in the developmental program. 




Variable 24. Student outcomes 

Academic performance is the ultimate validator of a learning 
improvement program. Appropriate measures include survival 
in the regular program and completion of the degree (Simmons 
et a!. 1979; Gordon 1975) and such indices as GPA and grades 
in certain subsequent .courses (Boy lan 1981; Roueche and Snow 
1977; Sparks and Davis 1977; Cross 1976; Maxwell 1970). 

The value-added concept is increasingly important in times 
of scarce resources. Therefore, researchers seek evidence of 
change and improvement. Student outcomes are judged relative 
to students* entry level aptitudes (Arkwardy and. Chafin 1980: 
McFadden 1979; Baird 1977; Roueche and Snow 1977), 

The measurement of change for remedial students is difficult 
because of the statistical and research design problems dis- 
cussed previously. The success of developmental programs de- 
pends in part on the criteria used (Cross 1976); many indices 
are preferable to a few (Barrow 1980; Trillin and Associates 1 
1980; Roueche and Snow 1977). Success must be defined in 
relation to both institutional and individual goals. For example, 
a failure to persist in at particular college might not represent a 
failure in cases where students are helped to clarify their own - 
goals and to find employment or to transfer to another school 
(New York State Education Department 1977; Roueche and 
Snow 1977). 

\ Standardized tests do not measure the specific reading skills 
that are developed m particular courses (Maxwell 1979; Ander- 
son 1973) and thus tend to understate the growth that may have 
occurred in reading ability (Flippo 1980). Results are likely to 
be\ more accurate and favorable when such variables are mea- 
sured as the attainment of a specific skill, the application of 
skills and knowledge in regular program courses, retention, the 
rates of continuation and success (as defined locally), academic 



status, attitudes and behaviors such as attendance and class par- 
ticipation, commitment, and decision-making skills (Walvekar 
1981, pp. 75-94; New York State Education Depai nent 1977, 
p. 741). Criterion measuies consistent with the objectives of 
the program are preferable to standardized tests, whic. aire in- 
appropriate for measuring an individual student's growth (Ark- 
wardy and Chafin 198b: Anderson 1973; Maxwell 1979, p. 
221). A student's perfonnance of the criterion task should be 
interpreted in relation to the specific performance standards, 
should reflect the instructional intent, and should generalize to 
the domain of instructionally relevant tasks in subsequent 
courses (Arkwardy and Chafin 1980). 

More accurate measures of academic success may be the key 
to making basic educational processes more meaningful in de- 
velopmental programs. Interest is emerging in measuring learn- 
ing processes as well as level of achievement; however, few 
useful instruments exist for doing so (Gordon 1975). Accept- 
able evidence includes data about interactions, small group 
feedback, indicators of attitude, and procedural research (New 
York State Education Department 1977; Gordon 1975). The 
"acceptability" of evidence is established by its appropriate- 
ness for the purpose for which it is used (Moore 1981; Max- 
well 1979). 

The grouping statistic, whether a cut-off score or an average, 
will affect the result obtained from evaluation (Trillin and As- 
sociates 1980). When a mean is the measure, it is a statistical / 
fact that by definition ha!f the people will always be below av-/ 
erage (Cross 1976, pp. 9-13). If a remedial program is limited 
to the weakest students, assistance to them may result in a j 
kk C" performance in a follow-on course for which the average 
grade is kk B." Comparing these scores could discredit the re-/ 
medial program and mask genuine gains in learning (Maxwep 
1979). Critririon-referenced cut-off scores are therefore-more 
meaningful indicatoe^-succ<ss-than-are average scores. 

Level I decisions. Student outcomes are assessed without an 
analysis of their entry-level abilities. 

Level II decisions. Student growth is assessed using general 
criteria for tests and grades. 

Level III decisions. Within an academic course, students' 
learning and change are assessed for each of those objectives 
foi which developmental and regular instructional activities 
have been integrated. Specific skills and knowledge are mea- 
sured by means of criterion tasks that are related to support of 
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the developmental program and to content of the regular aca- 
demic program. Grades in the regular program are a measure of 
success in the developmental program. 

Level IV decisions. Within academic courses, students' learn- 
ing and change arc assessed using many indices of participa- 
tion, persistence, and commitment. The same criterion tasks 
and criteria of success for Level III decisions are used. 

Variable 25. Academic standards and the grade point average 
Why does GPA as a criterion of success provide such inconsis- 
tent results as reported in the many studies in which it has been 
used? Do these findings reflect the inefticacy of the programs 
being evaluated or the inadequacy of GPA. as a criterion? What 
is the proper use of GPA as a criterion in learning improvement 
programs? 

Of itself, GPA is not a consistent standard, either among 
programs within a school or among colleges. Grading practices 
vary among faculty, departments, and colleges; grading stan- 
dards vary with changes in admissions policy or skills of admit- 
ted students (Gordon 1975). Because remedial programs work 
with the least prepared students, the apparent result of the pro- 
gram can be influenced by drifts in the admitted students' abil- 
ity profiles (Maxwell 1979, p. 189). 

Research does not support the use of GPA as the only crite- 
rion, but it does support it as one of the possible bases for 
judgment (Tillman 1973; Maxwell 1979). Furthermore, grade- 
related criteria sucji as GPA, success in follow-on courses, and 
the relation of credit hours earned to credit hours attempted are 
appropriate measures only when the developmental program is , 
designed to supplement the regular curriculum, not when it op- 
erates as a discrete program (Webb 1977). 

A definition of the standards of competence required in the 
courses that contribute to GPA and the relevance of those stan 
dards to the content of the developmental program must be dem- 
onstrated for GPA to,be a meaningful criterion. This information 
is not provided in many studies in which GPA is used as a crite- 
rion, however, particularly studies of isolated remedial reading 
programs. The omission of this information may account for the 
inconsistency of the results obtained in these studies. 

In effective programs, the evaluations have provided answers 
to several questions, about how developmental studies interface 
with the regular » "tame program: (1) Are valid entrance and 
exit standards t led? (2) Are regular faculty aware of the 
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standards? (3) Is the diagnosis of students' needs specific j 
enough to guide instruction? (New York State Education Pe- 
— partmcnt 1977). 

Level I decisions: CPA is used as a criterion of the effective- 
ness of remedial skills courses, which are assumed to be gener- 
ally relevant to the content of the academic program. 

Level 11 decisions. Grades in verbal or quantitative courses 
are used as a criterion of effectiveness for verbal or quantitative 
learning assistance to Individuals. The assumption lis that the 
individual s need to know in academic courses determines the 
questions he asks and thereby guides the support received, en- 
suring >me relevance to the content of the academic program. 

Lt i. i III decisions. Within an adjunct or follow-on academic 
coir c the relationship between regular and developmental in- 
struction and content is assessed. If the course grade is used as 
a criterion of the effectiveness of the developmental program, 
evaluators must decide whether the grade represents competen- 
cies developed in me remet' ogram.. 

Level IV decisions. The ci . . * uveness of the relationship be- 
tween the regular program and the developmental program is 
assessed. Evaluators decide whether entrance and exit standards 
are valid, recognized, and specific enough to guide h.s?i;uction. 
A criterion for GPA is interpreted in i:^ht of the standards of 
* achievement (i.e., competencies) represented 'by the grades 
from which GPA is derived. 



Variable 26. Ongoing evaluation 

Ongoing evaluation is associated with successful learning im- 
provement programs (Grant and Hoeber 1978; Roueche and 
Snow 1977; Gordon 1975). Systematic evaluation and problem 
solving help to clarify institutional goals and programmatic ob- 
jectives (Roueche and Snow 1977). Ongoing evaluation pro- 
vides the basis for improving instructional services (Simmons et 
al. 1979; Maxwell 1975). Continuous assessment of needs and 
dissemination of informs* about the population to be served 
by the developmental program are necessary to build aware- 
ness, support, and rationale for instructional services. Ongoing 
evaluation facilitates awareness, negotiation, and inr ovation. 
Which tend to produce not only better learning outcomes but 
also greater congruence beivteen institutional philosophy and 
the working objectives for the program being eyaluated. 

A comprehensive eva!? <on of a learning improvement pro- 
,gram should address s< i\ <l kinds of outcomes at various time 



Systematic 
evaluation 
and problem 
solving help 
to clarify 
institutional 
goals and 
programmatic 
objectives. 
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intervals. Follow up studies : * in ongoing component of 'pro- \ 
gram assessment, addressin; range goals, long-range ^ 

goals, carryover of skills jgular academic programs and \ 
requirements^ and focusing on students who leave as well !as 
those who corhplete the program (New York State Education 
' Department 1977, pp. 73-74). 

Level I decisions. No sy^ematic evaluation of the effects of 
the remedial progran- on students' overall i-.v*ming under- 
taken. 

Level 11 decisions. Evaluation is limited to a single seni't^oy. 
/ Level III decisions. The effects of instructional services 
V within a course and a related fohow-on cour-e are monitor - 
Level IV decisions. Students' lean.'^v outcomes and needs 
are periodically assessed, and academic and developmental fac- 
ulty receive regular feeCoack. Follow-up studies and analysis of 
long-term effects, trends, and changes are ongoing. 

The structure of the remedial/developmental program us a 

: facilitator of change 

The development of an 'innovative enclave" is a relatively in- 
expensive strategy for achieving institutional, "self-renewal" 
and change (Levine 1978, p. 419). Collaboration to solve prob- 

i lems is an effective strategy for change, normally requiring a 

consultant in the role of "outside facilitator" (Nordvall 1982). 
The learning specialist i fulfills the role of facilitator in success- . 

i ful learning improvement programs and uses the evaluation of 

needs and learning services as the starting point for problem 
ing. 

* i he process of change involves fmr steps: (!) research, 

which unt ;.*s possibilities and p f < Juce's a theoretical basis for 
change; ( ' ievefapnwnt \ which in ves design of alternatives; 
. (3) diffusion, which »j dissemination and demonstration per- 
suades target audiences to participate; and (4) adoption, which 
involves training, trial, installation, and institutionalization of 
the innovation (Stuffleteam 1971 , p. 51). 
, Involvement of interdisciplinary faculty in the evaluation and 

redesign of instruction occurs naturally in those settings in 
which remedial/developmental services are being planned coop- 
eratively for integration or have been ini - -ated into ongoing 
academic programs. The central focus of the evaluation is the 
processes of the developmental program — their appropriateness 
given students* needs and the specific outcomes desired. Inevi- 
tably, the participating regular and developmental faculty ana- 
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lyze regular progruui processes as well, seeking information to 
help them refine their own course, program, or service. The 
ensuing analysis ol a shared enterprise is unthreatening to par- 
ticipating faculty and affords evaluators much greater access 
and insight into regular programs than could otherwise be pos- 
sible. Data thus obtained are more likely to explain more of the 
factors that would otherwise tend to confound the results in 
studies including only developmental processes. 

An 1 organizational structure that fosters joint projects and 
evaluations is therefore the critical element \x the developmen- 
ts! program when the goal is evolutionary instructional change. 
Research has demonstrated that faculty's initiative and coopera- 
tion are essentia! if instructional development projects 
are to work and that faculty's initiative and cooperation are 
more important even than administrative and staff support 
(Lawrason and Hedberg 1^77). What better way to foster such 
initiative and cooperation than to provide the possibility of al- 
ternatives and the faculty's involvement in the process of 
change? 
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THE EMERGING ROLE FOR 
LEARING IMPROVMENT PROGRAMS 



The itsearch literature provides strong support for three conclu- 
sions tr.3T, when ignored in the design of learning improvement 
programs and evaluation studies, produce programs with pri- 
marily short-term effects and studies that do not explain the 
basic instructional processes contributing to students* achieve- 
ment. 

\ . In response to urgent pressures threatening academic val- 
ues and survival, educators seek improved learning and reten 
tion in ic overall academic program from their investment in 
remedial/developmental programs. These benefits have not been 
forthcoming from programs whose only service to the ^ kge is 
Isolated remedial courses. 

2. Instructional models for academic courses that ar< 
founded upon developmental learning theory and pro\*de for ail 
of the students* educational needs improve learning and arc fea- 
sible and cost effective when developmental program resources 
are aligned with academic program resources ' 

3. The most effective roles for remedial/developmental pro- 
grams in a college or university ar? those of catalyst and ener- 
gizer for instructional development and of codeveloper, guide, 
and deliverer of services to create more responsive educational 
environments. 

These generalizations can be expected to provide the most 
productive foundation for improved learning and academic pro- 
gram planning, as long as ;he current environment of declining 
population diminished resources, and increasingly unethical 
competition for students prevaiis. The Decision Guide for Ef- 
fective Programs is the pragmatic educator's blueprint for 
achieving survival with inr nrity and for controlling the pro- 
cesses of inevitable change 
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